Error while loading
I get the following error when loading Q4KM and Q5KM models
"llama.cpp error: 'invalid unordered_map<K, T> key'"
I use LM Studio.
Could you be checking what the issue might be?
Thanks for reporting this
@muratowski
It seems an issue with deepseek models and Llama.cpp, lots of reported issues on their github. As soon as I get an answer I will re-convert and re-quantize this model for you.
Thank you. Waiting for the good news!
Are there any updates regarding this? Since at the moment it's basically impossible to run this model
To follow the progress, there is this issues and this PR I share here for future references:
It seems a bit blocked, but not stale. Hopefully, we can get this going because deepseek itself has lots of good models and there are others fine-tuned on top of it.