pretty good
#1
by
McUH
- opened
Thanks for your work with these enhancements. CommandR 35B remains one of the best to run on 24GB VRAM with offload. And trying this IQ4_XS 200xq quant - it performs very well in roleplay. While I did not do any comprehensive tests, it does indeed seem like improvement over previous IQ4_XS's of this model.
Thank you for your feedback.
It really helps with tuning and future X quants.