Quantized model
#1
by
MaziyarPanahi
- opened
Thanks for sharing this model, I quantized it to GGUF format if anyone needs it:
https://huggingface.co/MaziyarPanahi/OpenHermes-2.5-Mistral-7B-mt-bench-DPO-original-v3-GGUF