Quantized model

#2
by MaziyarPanahi - opened

Thanks for sharing this model! I quantized it for GGUF format if anyone else is interested:

https://huggingface.co/MaziyarPanahi/Yarn-Solar-10b-32k-GGUF

Sign up or log in to comment