parallel training of deep neural networks with natural gradient and parameter averaging .
HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent