GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
183
TheFireHacker
TheFireHacker
AI & ML interests
LLM, sub quadraric attention, AI Agents , Synthetic Data
Recent Activity
liked
a model
about 17 hours ago
deepseek-ai/DeepSeek-V3-Base
Organizations
TheFireHacker's activity
upvoted
2
papers
10 months ago