Qwen
/

Qwen-7B-Chat-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

Qwen-7B-Chat-Int4

2 contributors

History: 28 commits

wangzihan99's picture

Add ApplyRoPE and RMSNorm kernels written in OpenAI Triton.

1b59f63 about 1 year ago