How to evaluate every X steps?
What is the best practice for performing evaluation on the dev and/or test set/s every X steps and not every epoch end?
In the documentation I saw the options of overriding validation_epoch_end and test_epoch_end, but could not find how to evaluate "more frequently".
Thanks!
Hi @zorikg! You can configure it through the trainer flag val_check_interval. e.g.
# check validation set 4 times during a training epoch
trainer = Trainer(val_check_interval=0.25)
https://pytorch-lightning.readthedocs.io/en/latest/common/trainer.html#val-check-interval