adamp (pypi): AdamP optimizer: Slowing Down the Weight Norm Increase in Momentum-based Optimizers
Keywords: deep-learning|iclr2021|machine-learning|optimizer|optimizer-algorithms|pytorch