Support Q2 imatrix quants

#95
by Dampfinchen - opened

hello,

I've noticed GGUF my Repo doesn't support Q2 quants for imatrix. This is a shame because those do especially benefit from it. Any plan to add Q2_K and IQ2_XXS with imatrix support?

Thanks!

I would also be in favor of imatrix 2 bit quants!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment