Nexesenex

/

MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF

like 69

Alas, eramax, I have only a small CPU (i7-6700k), and so I'm crunching only my favorite models, or at least good ones.
And CodeLlama 70b is an absolutely grotesque release of Meta in my opinion. I tested it, and deleted it on the spot.
Nevertheless, a lot of people might use it professionnally, so there's an audience and maybe Kooten or Artefact2 can help you, because they do these IQ quants also.

Alright, thanks