Quants ?
#1
by
Meggido
- opened
Hi, I'd love to try out this model. Could we have exl2 quants ? Or do you know the VRAM and RAM requirements to do it ?
Thank's for this model. I like it. Here's GGUF quants: https://huggingface.co/koesn/Nous-Hermes-2-SOLAR-10.7B-misaligned-GGUF