TicTac: Accelerating Distributed Deep Learning with Communication Scheduling
Horovod: fast and easy distributed deep learning in TensorFlow