Distributed stochastic optimization for deep learning (thesis)
HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent