GitHub repository: stjordanis/Best-Deep-Learning-Optimizers
Description: Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable