Before revision:  HyPar-Flow provides 110x speed up on 128 nodes of the Stampede2 cluster at TACC for hybrid-parallel training of ResNet-1001 .
After revision:  HyPar-Flow provides 110x speed up on 128 nodes of the Stampede2 nodes, and 3) 481x speedup over single-node on 512 Frontera nodes .