Is there any chance of getting this into a 4bit quantized (GPTQ as well?) version?

#1
by cleverest - opened

NM, I just noticed the file is exactly that already, haha!

Sign up or log in to comment