casperhansen
/

llama-3-8b-instruct-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

llama-3-8b-instruct-awq / quant_config.json

Commit History

Create quant_config.json

af7fe1d
verified

Suparious commited on Apr 18