Arm quants plz 😉
#1
by
StellarDragon
- opened
Title says it all, just want to experiment. 😁
They are already on the queue (they will be part of the imatrix set - you can check how far this model is here: http://hf.tst.eu/status.html), but since you asked, I will bump the priority of this model so it's the next one.
Cheers :)
mradermacher
changed discussion status to
closed
Oh, thanks! I see the I matrix ones but...
I don't see the Arm Q4_0_4_8 tho 😰
Am I blind? 😖
Unfortunately, you are not blind, they are indeed missing. Seems the node it was done one lacked the program that gave the size of the model, and therefore, it thought the model did not qualify for arm quants.
That's actually a good catch, thanks for bringing this up :=)
I'll redo it, and hopefully the quants will show up within a few hours.
Finally, they are there :)