Why do Learning Rates Transfer? Reconciling Optimization and Scaling Limits for Deep Learning Paper • 2402.17457 • Published Feb 27
Curvature-Informed SGD via General Purpose Lie-Group Preconditioners Paper • 2402.04553 • Published Feb 7