 HyPar-Flow provides 110x speed up on 128 nodes of the Stampede2 cluster at TACC for hybrid-parallel training of ResNet-1001 .
<meaning-changed>  HyPar-Flow provides 110x speed up on 128 nodes of the Stampede2 cluster at TACC for hybrid-parallel training of ResNet-1001 .
 HyPar-Flow provides 110x speedup over single-node on 128 nodes of the Stampede2 cluster at TACC for hybrid-parallel training of ResNet-1001 .