LLMQ
/

LLaMA-3-8B-AWQ-4bit-b128

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

No model card

New: Create and edit this model card directly on the website!

Contribute a Model Card

Downloads last month: 31

Collection including LLMQ/LLaMA-3-8B-AWQ-4bit-b128

LLaMA3-Quantization

This is the official quantized models collection of “How Good Are Low-bit Quantized LLaMA3 Models? An Empirical Study” • 9 items • Updated 30 days ago • 4