ModelCloud
/

glm-4-9b-gptq-4bit

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qubitium commited on Jun 6

Commit

30bc8e3

•

1 Parent(s): e859378

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -1,3 +1,5 @@
 World's first gptq 4bit quant of `glm-4-9b` model.
-Autogptq PR pending....zoom zoom.

 World's first gptq 4bit quant of `glm-4-9b` model.
+Autogptq PR: https://github.com/AutoGPTQ/AutoGPTQ/pull/683
+Please note ChatGLM has tendency to switch from English to Chinese in mid-reply or in direct reply to English prompt. This issue happens in both native and quantized model and needs further investigation.