ModelCloud
/

glm-4-9b-chat-gptq-4bit

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

glm-4-9b-chat-gptq-4bit / README.md

Qubitium's picture

Update README.md

4d86323 verified 9 months ago

|

91 Bytes

World's first gptq 4bit quant of glm-4-9b-chat model.

Autogptq PR pending....zoom zoom.