Some loggers also allow logging the hyperparams used in the experiment. For instance, when using the TensorBoardLogger, all hyperparams will show in the hparams tab at torch.utils.tensorboard.writer.SummaryWriter.add_hparams() … self.logger.log_hyperparams(self.hparams, {"hp/metric_1": 0, "hp/metric_2": 0}) … Subsequent updates can simply be logged to the metric keys