Quantization into 8bit/4bit?

#1
by Yhyu13 - opened

Would you release quantized versions of MathGLM like ChatGLM for the community?

Yhyu13 changed discussion title from Auto Quantization into 8bit/4bit? to Quantization into 8bit/4bit?
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment