The Ultra-Scale Playbook
🌌
3.92k
The ultimate guide to training LLM on large GPU Clusters
Vincent Feng
VincentFeng
·
AI & ML interests
None yet
Recent Activity
liked a Space 13 days ago
nanotron/ultrascale-playbook liked a model 21 days ago
mistralai/Mixtral-8x7B-v0.1 commentedon an article 21 days ago
Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLPOrganizations
None yet
liked a
Space 13 days ago
liked a
model 21 days ago
commented on Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP 21 days ago
thanks bro, it's really help, looking forward your next blog!
upvoted an article 22 days ago
Article
Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP
- +3
ariG23498, ror, sergiopaniego, pcuenq, sayakpaul
• • 50 upvoted an article 23 days ago
Article
Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler
- +3
ariG23498, sayakpaul, sergiopaniego, ror, pcuenq
• • 132 upvoted an article about 1 year ago
Article
The Annotated Diffusion Model
nielsr, kashif
• • 362 liked a
Space about 1 year ago