AutoGPTQ model loader crashes in text-gen-webui

#19
by KitsuCha - opened

Please make sure you're using the latest version of text-generation-webui

Click the Model tab.
Under Download custom model or LoRA, enter TheBloke/WizardCoder-15B-1.0-GPTQ.
Click Download.
The model will start downloading. Once it's finished it will say "Done"
In the top left, click the refresh icon next to Model.
In the Model dropdown, choose the model you just downloaded: WizardCoder-15B-1.0-GPTQ
The model will automatically load, and is now ready for use! <---β€” NO IT DOES NOT, you need to choose model loader and click LOAD

After I choose AutoGPTQ, it just outright crashes and that is it.

image.png

Anybody got anything like that?

Sign up or log in to comment