Hugging Face's logo

solidrust
/
Llama-3-Soliloquy-8B-v2-AWQ

Text Generation
Transformers
Safetensors
llama
4-bit precision
AWQ
Inference Endpoints
conversational
text-generation-inference
awq
Model card Files Community
Llama-3-Soliloquy-8B-v2-AWQ / quant_config.json

Commit History

Adding quant config
1c8422f
verified

Suparious commited on