TheBloke

/

Llama-2-7B-Chat-GGML

like 805

gguf_init_from_file: invalid magic number 67676a74
error loading model: llama_model_loader: failed to load model from models\llama-2-7b-chat.ggmlv3.q2_K.bin

llama_load_model_from_file: failed to load model
2023-10-16 12:10:46 ERROR:Failed to load the model.
Traceback (most recent call last):
File "E:\oobabooga_windows\text-generation-webui\modules\ui_model_menu.py", line 201, in load_model_wrapper
shared.model, shared.tokenizer = load_model(shared.model_name, loader)
File "E:\oobabooga_windows\text-generation-webui\modules\models.py", line 79, in load_model
output = load_func_maploader
File "E:\oobabooga_windows\text-generation-webui\modules\models.py", line 225, in llamacpp_loader
model, tokenizer = LlamaCppModel.from_pretrained(model_file)
File "E:\oobabooga_windows\text-generation-webui\modules\llamacpp_model.py", line 91, in from_pretrained
result.model = Llama(**params)
File "E:\oobabooga_windows\installer_files\env\lib\site-packages\llama_cpp_cuda\llama.py", line 365, in init
assert self.model is not None
AssertionError

Exception ignored in: <function LlamaCppModel.__del__ at 0x0000024EFFB1D870>
Traceback (most recent call last):
File "E:\oobabooga_windows\text-generation-webui\modules\llamacpp_model.py", line 49, in del
self.model.del()
AttributeError: 'LlamaCppModel' object has no attribute 'model'

CPU:I7-6700K
GPU:RTX 3060TI 8G
RAM:32G
OS:WIN11