The Anisotropic Noise in Stochastic Gradient Descent: Its Behavior of Escaping from Minima and Regularization Effects
Stochastic Gradient Descent Performs Variational Inference, Converges to Limit Cycles for Deep Networks