4 bit quants

#1
by KnutJaegersberg - opened

Tagging @TheBloke or if you would provide gptq 4 bit weights for this version, would be great!

Sign up or log in to comment