TheBloke

/

Llama-2-7B-Chat-GGML

like 812

issue:
error loading model: unrecognized tensor type 10
llama_init_from_file: failed to load model

code:
from ctransformers import CTransformers

llm=CTransformers(model="../model/llama-2-7b-chat.ggmlv3.q2_K.bin",
model_type="llama",
config={
'max_new_tokens':512,
'temperature': 0.8
}
)

How to solve this issue?