How to configure text-generation-webui

#4
by Cometyang - opened

I got the following error while other models don't have such issue.
"error loading model: missing tok_embeddings.weight"

Is there anyone successfully using this model in text-generation-webui?

deleted

i dont believe its supported yet. koboldcpp does work.

yes, I managed to run in koboldcpp, performance wise seems not very impressive, maybe needs more time to play

Sign up or log in to comment