Model Description

This is a 8bit GPTQ quantization of Llasa-1B by the HKUSTAudio team. I tested using a script written by GitHub user nivibilla, linked below. The tests were successful, and this quantized model produced very decent results.

Model Sources

Downloads last month
2
Safetensors
Model size
650M params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AgeOfAlgorithms/Llasa-1b-GPTQ-8bit

Quantized
(4)
this model