ayyoob-cis
/

vicuna-68m-gptq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

vicuna-68m-gptq / quantize_config.json

Commit History

AutoGPTQ model for vicuna-68m-gptq: 4bits, gr128, desc_act=False

ff150ba
verified

ayyoob-cis commited on May 17