TheBloke

/

falcon-40b-instruct-GPTQ

like 198

I've been trying to get this model and others to work in text-generation-webui but with a seeming unhelpful error:

2023-09-13 10:47:25 INFO:Loading TheBloke_falcon-40b-instruct-GPTQ...
2023-09-13 10:47:30 INFO:Loaded the model in 4.89 seconds.

2023-09-13 10:47:30 ERROR:Failed to load the model.
Traceback (most recent call last):
  File "/media/llm/oobabooga_linux/text-generation-webui/modules/ui_model_menu.py", line 199, in load_model_wrapper
    settings = get_model_metadata(selected_model)
  File "/media/llm/oobabooga_linux/text-generation-webui/modules/models_settings.py", line 31, in get_model_metadata
    for k in settings[pat]:
TypeError: 'NoneType' object is not iterable

Can you tell me what I'm doing wrong or how to debug this?