GitHub repository: HuangLK/llama-deepspeed
Primary language: Python
Created: 2023-04-05T07:02:13Z
Description: train llama-30B on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism