README.md

metadata

license: apache-2.0
language:
  - zh

chatglm3-6b-openvino-int4

The openvino version of chatglm3-6b, quantized to int4.
Can run fast on intel iGPU.

Usage

Please refer to intel's demo