Communication Complexity of Distributed Convex Learning and Optimization
HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent