rwightman/timm-optim-caution
Updated
•
8
'Tim' Lizhang Chen
lzchenut
AI & ML interests
None yet
Recent Activity
liked
a model
about 1 month ago
rwightman/timm-optim-caution
authored
a paper
about 1 month ago
Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts
authored
a paper
about 1 month ago
Communication Efficient Distributed Training with Distributed Lion
Organizations
None yet
lzchenut's activity
liked
a
model
about 1 month ago
authored
4
papers
about 1 month ago
Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts
Paper
•
2310.05898
•
Published
•
2
Communication Efficient Distributed Training with Distributed Lion
Paper
•
2404.00438
•
Published
•
2
Memory-Efficient LLM Training with Online Subspace Descent
Paper
•
2408.12857
•
Published
•
13
Cautious Optimizers: Improving Training with One Line of Code
Paper
•
2411.16085
•
Published
•
15