Loading from best checkpoint
🚀 Feature
Currently Pytorch lightning uses the latest version of the model for testing. In research, we want to first load the best checkpoint and do the testing from there. Also it would be good to restart from the best checkpoint after learning rate plateau as an option.
Motivation
We want the best model for training/testing. Also for NLP it is more natural to go to the best checkpoint and restart with decayed learning rate.
Alternatives
Manual loading and checking of the validation value (which is against lightning principal).