Spaces:

ggml-org

/

gguf-my-repo

like 1.04k

Running on A10G

hello,

I've noticed GGUF my Repo doesn't support Q2 quants for imatrix. This is a shame because those do especially benefit from it. Any plan to add Q2_K and IQ2_XXS with imatrix support?

Thanks!