GitHub repository: onlyrico/transformers-language-modeling
Description: Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3