casperhansen
/

vicuna-7b-v1.5-awq-gemv

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

vicuna-7b-v1.5-awq-gemv / pytorch_model.pt

Commit History

Rename awq_model_w4_g128.pt to pytorch_model.pt

6300f19

casperhansen commited on Oct 31, 2023