Dhruva Bansal

BansalDhruva's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in nanotron/ultrascale-playbook about 2 months ago

ZeRO-3 vs FSDP 1 vs FSDP 2

4

#75 opened about 2 months ago by

BansalDhruva

liked a Space about 2 months ago

Running

2.43k

2.43k

The Ultra-Scale Playbook

🌌

The ultimate guide to training LLM on large GPU Clusters