TheBloke

/

deepseek-coder-6.7B-instruct-GGUF

like 172

Getting this error:

libc++abi: terminating due to uncaught exception of
type std::out_of_range: unordered_map::at: key not found

Not even one token is predicted so the model is crashing directly...
Working normally for all other models so it is something specific to this one.

llama-cpp-python==0.2.20