QAT version

#7
by A-L-01 - opened

Hi, it would be great to have a QAT version of this, rather than standard quantization, especially for the int4 version. If anyone is so kind to do it, it would be great, this model is still going strong.

Sign up or log in to comment