GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
Aggregated Residual Transformations for Deep Neural Networks