No Loader can Load this model into ooba text-gen-webui
@TheBloke tried with several ways to load it but wasn't able to. Could you please have a look at it?
Thanks in advance.
e.g. ExLlamav2 error log
Traceback (most recent call last):
File "...\text-generation-webui\modules\ui_model_menu.py", line 213, in load_model_wrapper
shared.model, shared.tokenizer = load_model(selected_model, loader)
File "...\text-generation-webui\modules\models.py", line 87, in load_model
output = load_func_maploader
File "...\text-generation-webui\modules\models.py", line 385, in ExLlamav2_loader
model, tokenizer = Exllamav2Model.from_pretrained(model_name)
File "...\text-generation-webui\modules\exllamav2.py", line 44, in from_pretrained
config.prepare()
File "...\text-generation-webui\installer_files\env\lib\site-packages\exllamav2\config.py", line 150, in prepare
self.hidden_size = read_config["hidden_size"]
KeyError: 'hidden_size'