Smaller quants ( < Q3 )
#1
by
onealeph0cc
- opened
Is there any chance you're planning to make smaller quants?
I'm sure they're probably coming, such a big model takes a lot of time to convert.
Hopefully we see an IQ2_XS which might be close to usable.