getting error on textgernerationUI

#2
by hussainwali1 - opened

FileNotFoundError: [Errno 2] No such file or directory: ‘models\TheBloke_GPT4All-13B-snoozy-GPTQ\pytorch_model-00001-of-00006.bin’

Please delete the file pytorch_model.bin.index.json from your models folder. It shouldn't have been there and I've removed it from the repo now.

But the reason you're getting this error in the first place is that you don't have the GPTQ parameters correctly defined.

Firstly, please update your text-gen-ui to the latest version. There was a recent bug that meant GPTQ params didn't get saved properly.

Then follow steps 5+ in the README to save the settings and reload the model with them.

Sign up or log in to comment