HALO: Hadamard-Assisted Lossless Optimization for Efficient Low-Precision LLM Training and Fine-Tuning Paper • 2501.02625 • Published Jan 5 • 16
QuEST: Stable Training of LLMs with 1-Bit Weights and Activations Paper • 2502.05003 • Published 5 days ago • 36
ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16 Text Generation • Updated Nov 8, 2024 • 287 • 12
ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16 Text Generation • Updated Sep 14, 2024 • 32 • 17
AQLM+PV Collection Official AQLM quantizations for "PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression": https://arxiv.org/abs/2405.14852 • 25 items • Updated Dec 18, 2024 • 20