"create_tensor: tensor 'blk.0.ffn_down.weight' not found"

#2
by Ekolawole - opened

Run on LM Studio and you get error: "create_tensor: tensor 'blk.0.ffn_down.weight' not found"

Same for me I got this error:
Traceback (most recent call last):
File "c:/Users/llamacpp/phi2.py", line 2, in
llm = Llama(model_path="phixtral-2x2_8.gguf")
return self._model.n_vocab()
File "C:\Users\llamacpp.venv\lib\site-packages\llama_cpp\llama.py", line 251, in n_vocab
assert self.model is not None
AssertionError

The model is broke!

Owner

You need to use this PR that is still a draft. So yes it doesn't work well yet.

Sign up or log in to comment