Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs
Asynchronous stochastic gradient descent for DNN training