Просто сделал квантизацию модели

Downloads last month
2
Safetensors
Model size
2.31B params
Tensor type
I32
·
FP16
·
Inference API
Unable to determine this model's library. Check the docs .

Model tree for andretisch/llava-saiga-8b-awq

Quantized
(1)
this model