fleet-lightning (pypi): Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep 
Keywords: paddlepaddle|distributed-training|deep-learning|benchmark|cloud|data-parallelism|distributed-algorithm|elastic|fleet-api|large-scale|lightning|model-parallelism|paddlecloud|pipeline-parallelism|pretraining|self-supervised-learning|unsupervised-learning