Deep learning with Elastic Averaging SGD
1-bit stochastic gradient descent and its application to data-parallel distributed training of speech DNNs.