Scaling Up Distributed Stochastic Gradient Descent Using Variance Reduction.
Deep learning with Elastic Averaging SGD