This repo only contains the Q8, Q6, Q5, & Q4 GGUF files of Aglow Vulca v0.1

For the details of this model, please refer to the orginal model card here.

Downloads last month
21
GGUF
Model size
8.03B params
Architecture
llama

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Model tree for kromquant/L3.1-Aglow-Vulca-v0.1-8B-GGUFs

Quantized
(10)
this model