Qwen
/

Qwen-7B-Chat-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

Qwen-7B-Chat-Int4

Commit History

Merge branch 'main' of https://huggingface.co/Qwen/Qwen-7B-Chat-Int4 into pr/6

7fa16ca

wangzihan99 commited on Dec 4, 2023

update modeling_qwen.py

1e66ba4

yangapku commited on Dec 3, 2023

Improve performance witih Triton 2.0 and adapt to latest Qwen releases.

5b354c8

wangzihan99 commited on Dec 1, 2023

Merge branch 'main' of https://huggingface.co/Qwen/Qwen-7B-Chat-Int4 into pr/6

74a1327

wangzihan99 commited on Dec 1, 2023

update

5ff8f11

yangapku commited on Nov 30, 2023

Add fused ApplyRoPE and RMSNorm kernels written in OpenAI Triton.

89a2cd3

wangzihan99 commited on Nov 15, 2023

remove fix-sized causal mask

c02ede5

yangapku commited on Nov 14, 2023

update wechat.png

ea58180

yangapku commited on Nov 14, 2023

add kernel file check in modeling_qwen.py

5bfdae9

yangapku commited on Nov 5, 2023

update modeling.py

8750247

yangapku commited on Oct 26, 2023

update int8 quantization info

95590fa

yangapku commited on Oct 17, 2023

update modeling_qwen.py

6ec2d41

yangapku commited on Oct 16, 2023

update batch inference

246a75e

yangapku commited on Oct 14, 2023

update default generate hyperparams

a3c216d

yangapku commited on Oct 13, 2023

format

02fc63b

yangapku commited on Oct 11, 2023

update tokenization.py

aa4c54a

yangapku commited on Oct 9, 2023

update tokenization.py

c70791d

yangapku commited on Oct 9, 2023

Update README.md

ad78953

JustinLin610 commited on Oct 8, 2023

Update README.md (#5)

33be903

JustinLin610 commited on Oct 8, 2023

Update README.md

b725fe5

yangapku commited on Sep 29, 2023

Update README.md

0e4b3b8

yangapku commited on Sep 29, 2023

softmax_in_fp32

682f4da

yangapku commited on Sep 28, 2023

update modeling_qwen.py

f6d1017

yangapku commited on Sep 27, 2023

update kernels

1581be8

yangapku commited on Sep 27, 2023

update modeling_qwen.py

fcc99d6

yangapku commited on Sep 26, 2023

update modeling_qwen.py

f4b568f

yangapku commited on Sep 25, 2023

Upload 2 files

3b3a62f

yangapku commited on Sep 25, 2023

Upload code_interpreter_showcase_001.jpg

f4934ae

yangapku commited on Sep 25, 2023

update kvcache

0e3568a

yangapku commited on Sep 25, 2023

update readme

8afa075

yangapku commited on Sep 25, 2023

update model

ff5200f

yangapku commited on Sep 25, 2023