Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack

#2
by Kazini - opened

As title states, the repo is missing files.
Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack

Was also reported here:
https://github.com/oobabooga/text-generation-webui/issues/122#issuecomment-1560104217

No, the repo is not missing any files.

This error comes because text-generation-webui hasn't understood that the model is a GPTQ model, so it's trying to load it as a normal HF model.

And it's not understood that it's a GPTQ model because you haven't entered the GPTQ parameters. Please follow the instructions in the README.

Huh! Seems like I didn't perform the steps correctly the first time, you're absolutely right. Apologies, and thank you for the assistance!

Sign up or log in to comment