Fix values in quantize_config.json
#1
by
linuxcl4
- opened
I noticed the values in quantize_config.json don't match the settings listed for the main branch in the model table in the README. After pulling the latest changes from main, I get CUDA illegal memory access errors during generation. These changes allow me to run the model again.
The only other model I checked was guanaco-65B-GPTQ, but it seems like it might be in a similar situation.
Thank you!
I had a config error when adding the new quants to this repo and Guanaco and Robin 65B, that uploaded the wrong format to main. I removed the dupe files but forgot to fix this.
TheBloke
changed pull request status to
merged