chatglm3-6b-rkllm / README.md
jxke's picture
chore: Added README.md with Convert chatglm3-6b to RKLLM format for Rockchip devices
94346a0
metadata
language:
  - zh
  - en
tags:
  - glm
  - chatglm
  - thudm
  - chatglm3-6b
  - rkllm
  - rk3588

chatglm3-6b-rkllm

This is a conversion from chatglm3-6b to the RKLLM format for chat in Rockchip devices.

Support Devices

  • RK3588/RK3588s

Convert tools

To Converting LLMs for Rockchip's NPUs, please see the artical1,2 for model details.

Converted with RKLLM runtime

  • RKLLM runtime 1.0.1

License

Same as the original chatglm3-6b

Reference

  1. airockchip/rknn-llm
  2. Pelochus/ezrknn-llm