Hugging Face's logo

solidrust
/
Llama-3-8B-Instruct-v0.5-AWQ

Text Generation
Transformers
Safetensors
PyTorch
English
llama
4-bit precision
AWQ
Inference Endpoints
axolotl
finetune
facebook
meta
llama-3
conversational
text-generation-inference
awq
Model card Files Community
Llama-3-8B-Instruct-v0.5-AWQ / quant_config.json

Commit History

adding quant config
49f4aed
verified

Suparious commited on