microsoft/megatron-deepspeed: Ongoing research training transformer language models at scale, including: BERT & GPT-2
Category: llm
Language: Python