The Ultra-Scale Playbook
🌌
3.88k
The ultimate guide to training LLM on large GPU Clusters
Ning Xie
andyxning
·
AI & ML interests
Inference
Recent Activity
upvoted an article 1 day ago
Accelerate ND-Parallel: A guide to Efficient Multi-GPU Training upvoted an article 5 days ago
Mixture of Experts (MoEs) in Transformers upvoted an article 7 days ago
Mixture of Experts ExplainedOrganizations
None yet
liked a
Space 7 days ago