HPGO (cargo): Hybrid Parallelism Global Orchestration
Keywords: data-parallelism|distributed-training|gpipe|machine-learning|model-parallelism|pipedream|pipeline-parallelism|pytorch|rust|tensorflow