CrossBow: Scaling Deep Learning on Multi-GPU Servers
Don't Decay the Learning Rate, Increase the Batch Size