EfficientQAT - a ChenMnZ Collection

ChenMnZ 's Collections

EfficientQAT(w/o E2E-FT)

EfficientQAT(GPTQ format)

EfficientQAT (BitBLAS format)

EfficientQAT

updated 4 days ago

The official prequantized EfficientQAT models.

ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128

Text Generation • Updated about 10 hours ago • 8
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g64

Text Generation • Updated about 10 hours ago • 4
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g128

Text Generation • Updated about 10 hours ago • 3
ChenMnZ/Llama-3-8b-EfficientQAT-w4g128

Text Generation • Updated about 11 hours ago • 4
ChenMnZ/Llama-3-8b-EfficientQAT-w3g128

Text Generation • Updated about 11 hours ago • 1
ChenMnZ/Llama-3-8b-EfficientQAT-w2g64

Text Generation • Updated about 11 hours ago • 1
ChenMnZ/Llama-3-8b-EfficientQAT-w2g128

Text Generation • Updated about 11 hours ago
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128

Text Generation • Updated about 9 hours ago • 1
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w3g128

Text Generation • Updated about 11 hours ago • 2
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g64

Text Generation • Updated about 11 hours ago • 6
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g128

Text Generation • Updated about 12 hours ago • 10
ChenMnZ/Llama-2-7b-EfficientQAT-w4g128

Text Generation • Updated about 13 hours ago • 1
ChenMnZ/Llama-2-7b-EfficientQAT-w3g128

Text Generation • Updated about 13 hours ago • 3
ChenMnZ/Llama-2-7b-EfficientQAT-w2g64

Text Generation • Updated about 13 hours ago • 8
ChenMnZ/Llama-2-7b-EfficientQAT-w2g128

Text Generation • Updated about 13 hours ago • 3
ChenMnZ/Llama-2-70b-EfficientQAT-w2g64

Text Generation • Updated about 13 hours ago • 1
ChenMnZ/Llama-2-70b-EfficientQAT-w2g128

Text Generation • Updated about 13 hours ago • 1
ChenMnZ/Llama-2-13b-EfficientQAT-w4g128

Text Generation • Updated about 13 hours ago • 1
ChenMnZ/Llama-2-13b-EfficientQAT-w3g128

Text Generation • Updated about 13 hours ago • 1
ChenMnZ/Llama-2-13b-EfficientQAT-w2g64

Text Generation • Updated about 13 hours ago
ChenMnZ/Llama-2-13b-EfficientQAT-w2g128

Text Generation • Updated about 13 hours ago • 1
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w3g128

Text Generation • Updated about 10 hours ago • 1
ChenMnZ/Llama-3-70b-EfficientQAT-w4g128

Text Generation • Updated about 13 hours ago • 4 • 1
ChenMnZ/Llama-3-70b-EfficientQAT-w3g128

Text Generation • Updated about 13 hours ago • 3 • 1
ChenMnZ/Llama-3-70b-EfficientQAT-w2g64

Text Generation • Updated about 13 hours ago • 3 • 1
ChenMnZ/Llama-2-70b-EfficientQAT-w4g128

Text Generation • Updated about 13 hours ago • 5 • 1
ChenMnZ/Llama-2-70b-EfficientQAT-w3g128

Text Generation • Updated about 13 hours ago • 4 • 1
ChenMnZ/Llama-3-70b-EfficientQAT-w2g128

Text Generation • Updated about 13 hours ago • 5 • 1
EfficientQAT: Efficient Quantization-Aware Training for Large Language Models

Paper • 2407.11062 • Published 12 days ago • 3