Llama 3.1 GPTQ, AWQ, and BNB Quants
Collection
Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗
•
9 items
•
Updated
•
50
Daniël de Kok
danieldk
AI & ML interests
Fast, low-level ML code, model implementation
Organizations
