GPTQ Version
#1
by
flozi00
- opened
flozi00
changed discussion status to
closed
Sorry, I didn't get a chance to do this yesterday and I see you've done it yourself now so I'll leave it to you. Congrats on the new model release!
If you want to do GGMLs as well, see this simple script: https://github.com/ggerganov/llama.cpp/blob/master/examples/make-ggml.py