mesolitica
/

llava-v1.6-34b-hf-awq

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Edit model card

Llava-1.6 34B AWQ

You need to use this forked, https://github.com/WanBenLe/AutoAWQ-with-llava-v1.6

Downloads last month: 17

Safetensors

Model size

5.76B params

Tensor type

I32

·

BF16

·

FP16

·

Unable to determine this model’s pipeline type. Check the docs .