How can I run these models in oobabooga / text-generation-webui?
#4
by
victorx98
- opened
it complains "no config.json". And what are the command line parameters should be?
Thanks!
Sorry, this happens because I named the models GGML.bin instead of ggml.bin.
There is no config.json for GGML models, you get this error just because text-gen-ui doesn't realise it's a GGML model. text-gen-ui decides to use llama.cpp for a model if it has ggml in its name, and this check is case sensitive.
All you need to do is rename whatever file you are using to ...ggml.bin instead of ...GGML.bin and then text-gen-UI will load it.
I have renamed the GGML files in the repo to ggml.bin so it won't affect future users.