GitHub repository: HuangLK/transpeeder
Primary language: Python
Description: train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism