Error Feedback Fixes SignSGD and other Gradient Compression Schemes
1-bit stochastic gradient descent and its application to data-parallel distributed training of speech DNNs.