CrossBow: Scaling Deep Learning on Multi-GPU Servers
Deep learning with Elastic Averaging SGD