GPU Asynchronous Stochastic Gradient Descent to Speed Up Neural Network Training
HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent