GPTQ Please?

#1
by Kotokin - opened

Hi, can you please make a GPTQ version?

I tried but I can't, you gotta wait for TheBloke man, i'm sorry.

I kind of successfully finished the GPTQ version, if you don't mind I can publish it.

I kind of successfully finished the GPTQ version, if you don't mind I can publish it.

You can publish, just point to the OG fp16 files in the model card, thank you! Appreciate it!

Kotokin changed discussion status to closed

Sign up or log in to comment