Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mesolitica
/
llava-v1.6-34b-hf-awq
like
0
Follow
Mesolitica
2
Transformers
Safetensors
llava_next
pretraining
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
Edit model card
Llava-1.6 34B AWQ
Llava-1.6 34B AWQ
You need to use this forked,
https://github.com/WanBenLe/AutoAWQ-with-llava-v1.6
Downloads last month
18
Safetensors
Model size
5.76B params
Tensor type
I32
路
BF16
路
FP16
路
Inference API
Unable to determine this model鈥檚 pipeline type. Check the
docs
.