---

NOTE Model and Model card from: https://huggingface.co/Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp This repo is mainly to share quantized gguf to use with clients like LMStudio, contains q4 and q8 quantization along with f16.

How to quantize? https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#prepare-data--run

OpenHermes-2.5-neural-chat-v3-3-Slerp

Slerp merge of OpenHermes-2.5-Mistral-7B and neural-chat-7b-v3-3 This is a quantized gguf version.

Open LLM Leaderboard Evaluation Results

Base Model's Eval (better than OpenHermes-2.5-Mistral-7B btw) - https://huggingface.co/Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp#open-llm-leaderboard-evaluation-results

So, a bit worse but not too different.