Thanks for the new quants
#1
by
FlareRebellion
- opened
From my (non substantiated) impressions IQ3_XXS is a pretty great bang for your buck. Good file size and pretty coherent.
You're welcome, FlareRebellion.
Let's say that IQ3_XXS is between Q3_K_XS and Q3_K_S in terms of overall quality (accordingly to my own benchs), and can even beat Q3_K_S on some metrics.
Credit : Artefact2
@Nexesenex , could you please have a look at this post here? I was waiting for your reply to this post, but i believe you didn't notice it: https://huggingface.co/Nexesenex/WinterGoddess-1.4x-limarpv3-70B-L2-32k-Requant.GGUF/discussions/1#65bee41d2e67686440020204