Exl2 quantized versions of https://huggingface.co/Herman555/OpenHermes-2.5-AshhLimaRP-Mistral-7B-GGUF using the pippa dataset (RP oriented) at 4096 length from TheBloke discord server.
Unable to determine this model's library. Check the
docs
.