Article
GaLore: Advancing Large Model Training on Consumer-grade Hardware
By
and 8 others
•
•
28Sourab Mangrulkar
smangrul
AI & ML interests
Machine Learning, Deep Learning, Natural Language Processing, Natural Language Generation, Computer Vision, Reinforcement Learning
Recent Activity
liked
a model
6 days ago
Qwen/Qwen2.5-1.5B-Instruct
liked
a Space
20 days ago
huggingface/ai-deadlines
liked
a model
2 months ago
mistralai/Mistral-7B-Instruct-v0.3
Organizations
smangrul's activity
published
an
article
12 months ago
published
an
article
about 1 year ago
Article
🤗 PEFT welcomes new merging methods
By
and 1 other
•
•
16
published
an
article
over 1 year ago
Article
Mixture of Experts Explained
By
and 5 others
•
•
467
published
an
article
over 1 year ago
Article
Personal Copilot: Train Your Own Coding Assistant
By
and 1 other
•
•
46
published
an
article
over 1 year ago
Article
Fine-tuning Llama 2 70B using PyTorch FSDP
By
and 3 others
•
•
22
published
an
article
almost 2 years ago
Article
The Falcon has landed in the Hugging Face ecosystem
By
and 7 others
•
•
12
published
an
article
almost 2 years ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
By
and 4 others
•
•
129
published
an
article
about 2 years ago
Article
Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU
By
and 5 others
•
•
43
published
an
article
about 2 years ago
Article
🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware
By
and 1 other
•
•
63
published
an
article
over 2 years ago
Article
Accelerate Large Model Training using DeepSpeed
By
and 1 other
•
•
4
published
an
article
almost 3 years ago
Article
Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel
By
and 1 other
•
•
4