Llama 3.1 GPTQ, AWQ, and BNB Quants
Collection
Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗
•
9 items
•
Updated
•
56
Mazzeschi
Michelangiolo
AI & ML interests
None yet
Organizations
