GPTQ version
#1
by
FrankWu
- opened
Can anyone provide a GPTQ version？
modelscope community provided one with their SWIFT framework, although I didn't try out myself.
https://www.modelscope.cn/models/tclf90/Yi-1.5-34B-Chat-16K-GPTQ-Int3/summary
lorinma
changed discussion status to
closed