llmat
/

Qwen2.5-32B-Instruct-AutoRound-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qwen2.5-32B-Instruct-AutoRound-GPTQ-4bit

Commit History

Upload folder using huggingface_hub

1ce35dc
verified

llmat commited on Nov 27, 2024

initial commit

b979749
verified

llmat commited on Nov 27, 2024