Non-K Quant q4_0
#1
by
Pathos
- opened
Really just asking if you could include that one, I don't really use any of the others if I can at all help it. The K Quants aren't much better and they're way slower on my P40.
I don't think 8k context works with non K quants AFAIK.