4-bit?

#1
by Sierra369 - opened

It seems to spit out a lot of nonsense if I use 4-bit, is that normal?

This comment has been hidden

I do not believe so. I have seen people quant and use it just fine.

Neko-Institute-of-Science changed discussion status to closed

Sign up or log in to comment