GPTQ Please?
#1
by
Kotokin
- opened
Hi, can you please make a GPTQ version?
I tried but I can't, you gotta wait for TheBloke man, i'm sorry.
I kind of successfully finished the GPTQ version, if you don't mind I can publish it.
I kind of successfully finished the GPTQ version, if you don't mind I can publish it.
You can publish, just point to the OG fp16 files in the model card, thank you! Appreciate it!
Kotokin
changed discussion status to
closed