shuttleai
/

shuttle-3-mini-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

shuttle-3-mini-GPTQ-Int4 / config.json

Commit History

Update config.json

6e129ec
verified

xtristan commited on Sep 23, 2024

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False

0940d8b
verified

xtristan commited on Sep 23, 2024