The Anisotropic Noise in Stochastic Gradient Descent: Its Behavior of Escaping from Minima and Regularization Effects
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour