Hugging Face's logo

ModelCloud
/
glm-4-9b-chat-gptq-4bit

Transformers
Safetensors
chatglm
custom_code
Inference Endpoints
4-bit precision
gptq
Model card Files Community
1
Qubitium commited on
Commit
29666cf
•
1 Parent(s): 6c22367

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -1,3 +1,5 @@
1
  World's first gptq 4bit quant of `glm-4-9b-chat` model.
2
 
3
- Autogptq PR pending....zoom zoom.
 
 
 
1
  World's first gptq 4bit quant of `glm-4-9b-chat` model.
2
 
3
+ Autogptq PR: https://github.com/AutoGPTQ/AutoGPTQ/pull/683
4
+
5
+ Please note ChatGLM has tendency to switch from English to Chinese in mid-reply or in direct reply to English prompt. This issue happens in both native and quantized model and needs further investigation.