Hyperparameter Tuning in Lightning CLI
I wonder how people do Hyperparameter Tuning with Lightning CLI?
Any suggestion of good practices?
Thanks!
Personally when I tune hyperparameters (e.g. with optuna or nevergrad), I don't use the Lightning CLI much but use the programmatic way to inject the arguments there (since it's easier for communication across different python libs directly in python and not leaving it to os calls).