Request
#2
by
HR1777
- opened
Hi Maziyar,
I have another great model in mind that I believe would be even better if a GGUF version were available. If possible, could you kindly create a GGUF version of it?
https://huggingface.co/THUDM/chatglm3-6b-128k
Hi @HR1777
Unfortunately, it's not supported yet on Llama.cpp: https://github.com/ggerganov/llama.cpp/issues/3808
I am also not sure how to use their own cpp they offer here (https://github.com/li-plus/chatglm.cpp)
OK, thank you so much. You are the best.
HR1777
changed discussion status to
closed