torchgpipe (pypi): GPipe for PyTorch
Keywords: pytorch|gpipe|checkpointing|deep-learning|model-parallelism|parallelism|pipeline-parallelism