GitHub repository: JRC1995/DemonRangerOptimizer
Primary language: Python
Created: 2020-04-18T23:24:42Z
Description: Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay