README.md

metadata

language:
  - zh
  - en
pipeline_tag: text-generation
tags:
  - qwen
  - qwen-chat-1_8B
  - rkllm
  - rk3588

Qwen-chat-1_8B-rkllm

This is a conversion from Qwen-1_8B-Chat to the RKLLM format for chat in Rockchip devices.

• Qwen-chat-1_8B-rkllm
  • Support Devices
  • Convert tools
  • Converted with RKLLM runtime
  • License
  • Reference

Support Devices

• RK3588/RK3588s

Convert tools

To Converting LLMs for Rockchip's NPUs, please see the artical^1,2 for model details.

Converted with RKLLM runtime

• RKLLM runtime 1.0.1

License

Same as the original Qwen-1_8B-Chat

Reference

1. airockchip/rknn-llm
2. Pelochus/ezrknn-llm