Can some one link me to gguf?
#1
by
Hugs4Llamas
- opened
Can someone link me to gguf quants if they already exist? Q4_K_S would be preferred but others might also work. I have good experience with NeuralHermes so I would like to try this out locally.
Hi @Hugs4Llamas thanks for your interest! We haven't created those yet, will let you know as soon as we have them