GitHub repository: AFDWang/Hetu-Galvatron
Primary language: Python
Description: Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs). If you have any interests, please visit/star/fork https://github.com/PKU-DAIR/Hetu-Galvatron