Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep Learning
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour