exl2 quants?

#1
by koesn - opened

Your 32k version of the 70b model is really amazing. Still no exl2 quants to this 8b.

Sign up or log in to comment