Attention quantization: HQQ 4-bit, groupsize 64, compress zero, compress scale with groupsize 256
Experts quantization: HQQ 2-bit, groupsize 16, compress zero, compress scale with groupsize 128

Downloads last month: 20

Safetensors

Model size

17.9B params

Tensor type

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.