SEG FAULT

#1
by draganjovanovich - opened

I am getting segmentation fault using this model with latest main ./server from llama.cpp
Can be that weights files are corrupted?

I am also getting segmentation fault error with llama.cpp

Loading model: D:\AI\wizardcoder\ggml\wizardcoder-python-13b-v1.0.Q5_K_M.gguf
[Threads: 7, BlasThreads: 7, SmartContext: False]

ERROR: Detected unimplemented GGUF Arch:


Identified as LLAMA model: (ver 6)
Attempting to Load...

@draganele @spikespiegel @dbddv01 @kazami2 did you guys by a chance forgot to rebuild llama.cpp after git pull? Cause this happen to me earlier. And after building all works again

Yes, after rebuilding everything works now.

yes, updating llama-cpp-python did the trick.

Sign up or log in to comment