Qwen
/

Qwen2.5-3B-Instruct-GPTQ-Int8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Qwen2.5-3B-Instruct-GPTQ-Int8

Commit History

update config.json

e0f0651

feihu.hf commited on Sep 18, 2024

update tokenizer_config

4882fb9

feihu.hf commited on Sep 18, 2024

upload weights

6ee00e2

feihu.hf commited on Sep 17, 2024