GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
182
Jeong seungwoo
hangsiin
AI & ML interests
Vision, NLP, Self-training, Data science, AI Ethics
Organizations
None yet
hangsiin's activity
upvoted
4
papers
9 months ago
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
Paper
•
2402.19427
•
Published
•
52
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper
•
2402.17764
•
Published
•
603
Genie: Generative Interactive Environments
Paper
•
2402.15391
•
Published
•
71