arxiv:2503.09799
Keith Rush
jkr26
·
AI & ML interests
Distributed ML, autodiff, scale and speed, and private ML
Recent Activity
authored
a paper
2 months ago
Streaming DiLoCo with overlapping communication: Towards a Distributed
Free Lunch
authored
a paper
2 months ago
Communication-Efficient Language Model Training Scales Reliably and
Robustly: Scaling Laws for DiLoCo
Organizations
models
0
None public yet
datasets
0
None public yet