csdc-atl
/

Baichuan2-7B-Chat-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Baichuan2-7B-Chat-GPTQ-Int4 / generation_config.json

Commit History

gptq int4

4377b20

waterhorse1 commited on Sep 14, 2023