Qwen
/

Qwen-7B-Chat-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

Qwen-7B-Chat-Int4 / kernels /cache_autogptq_cuda_kernel_256.cu

Commit History

update kvcache

0e3568a

yangapku commited on Sep 25, 2023