Adding new GGUF quants: Sonya-7B-GGUF-IQ-Imatrix

#3
by Lewdiculous - opened

As per request.
At https://huggingface.co/Lewdiculous/Sonya-7B-GGUF-IQ-Imatrix.

Sanji seal of quality of course.

Sign up or log in to comment