ZeroWw

/

glm-4-9b-chat-GGUF

like 4

I am unable to run the model using the latest llama.cpp(b3286)

e:\ai\llama.cpp\llama-cli -m glm-4-9b-chat.q5.gguf

llama_model_load: error loading model: error loading model architecture: unknown model architecture: 'chatglm'

Yep.. I know you have to use a different version: https://github.com/mnlife/llama.cpp

I just added that in the model card.