Hugging Face's logo

solidrust
/
Llama-3-8B-Instruct-Gradient-4194k-AWQ

Text Generation
Transformers
Safetensors
llama
4-bit precision
AWQ
Inference Endpoints
conversational
text-generation-inference
awq
Model card Files Community
Llama-3-8B-Instruct-Gradient-4194k-AWQ / quant_config.json

Commit History

adding quant config
b51ba37
verified

Suparious commited on