cnmoro
/

vicuna-7b-v1.5-SPR-Compressor-AWQ

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

AWQ version of cnmoro/vicuna-7b-v1.5-SPR-Compressor

Downloads last month: 12

Safetensors

Model size

1.13B params

Tensor type

I32

·

FP16

·