Q4_K_S
#1
by
Alastar-Smith
- opened
Hello!
Can you please add Q4_K_S Qt, this is the right size that feet my system well.
Thank you in advance!
Alastar
iQ4xs is slightly smaller and slightly better than Q4ks. You should use that instead.
iQ4xs is slightly smaller and slightly better than Q4ks. You should use that instead.
Ty for answer.
I've already tried iQ4sx, all iQ quants run way slower on cpu for some reason.
iQ3 have same speed for me like Q4_K_S don't really know why.
I've found Q4_K_S, don't worry.