Article
A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes
•
61
Bal Narendra Sapa
bnsapa
·
AI & ML interests
None yet
Organizations
None yet
bnsapa's activity
upvoted
3
articles
3 months ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
•
88
Article
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
•
209