Kooten made IQ quants of Miqumaid v1
#3
by
Nexesenex
- opened
IQ3_XXS, IQ2_XS and IQ2_XXS are here : https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF
Nexesenex
changed discussion title from
Kooten made IQ quants
to Kooten made IQ quants of Miqumaid v1
Nexesenex, can you compare your Miqu quant against Kooten's? I did a basic test and feel something is wrong, but I am hardly the most empirical when it comes to testing. I put my three one-shot tests at Kooten's IQ2 repository. MiquMaid Q2, MiquMaid IQ2xs, and Miqu IQ2xs were compared, and MiquMaid IQ2xs was significantly different.