Before revision:  HyPar-Flow provides 110x speed up on 128 nodes of the Stampede2 cluster at TACC for hybrid-parallel training of ResNet-1001 .
After revision:  HyPar-Flow provides 110x speedup over single-node on 128 nodes of the Stampede2 cluster at TACC for hybrid-parallel training of ResNet-1001 .