I am able to load other gguf models, but not this one
#1
by
LaferriereJC
- opened
Traceback (most recent call last):
File "/data/text-generation-webui/modules/ui_model_menu.py", line 220, in load_model_wrapper
shared.model, shared.tokenizer = load_model(selected_model, loader)
File "/data/text-generation-webui/modules/models.py", line 76, in load_model
metadata = get_model_metadata(model_name)
File "/data/text-generation-webui/modules/models_settings.py", line 58, in get_model_metadata
metadata = metadata_gguf.load_metadata(model_file)
File "/data/text-generation-webui/modules/metadata_gguf.py", line 79, in load_metadata
key = file.read(key_length)
MemoryError
And I was unable to load other GGUFs with the latest LLAMA.cpp at the time so I converted and tested it myself.