Joseph717171
/

Llama-3.1-SuperNova-Lite-8.0B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

GGUF

Inference Endpoints

imatrix

conversational

Model card Files Files and versions Community

Llama-3.1-SuperNova-Lite-8.0B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF / README.md

Joseph717171

Update README.md

1f34f10 verified 3 months ago

preview code

raw

history blame

229 Bytes

Custom GGUF quants of arcee-ai’s [Llama-3.1-SuperNova-Lite-8B](https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite), where the Output Tensors are quantized to Q8_0 while the Embeddings are kept at F32. Enjoy! 🧠🔥🚀