What is the reason? I can load any LLaMa model or MIxtral without any problems, but I can’t do this. Model loader is llama cpp
I'm sorry I'm not familiar with that software, I tested the quants with latest llama.cpp.
· Sign up or log in to comment
