README.md

metadata

license: apache-2.0
language:
  - en
  - zh
library_name: transformers
tags:
  - chat
  - llama

ChatGLM2-6B-GGLM

• Q4_0
• Q4_1
• Q8_0

Can be loaded and used by chatglm.cpp

chatglm -m ./models/chatglm2-6b-ggml.q8_0.bin -p 你好