Llama-3.2-1B-Instruct โ€” configuration c3 (W4A16_ASYM)

Quantized variant used in the Safety-Aware Configuration-Conditioned LoRA study.

field value
scheme W4A16_ASYM
method awq
simulated no โ€” native kernel
weight bits 4
activation bits 16
group / block size 128
symmetric False
calibration 512 ร— 2048 tok, C4
calibration sha256 b5736155d5b24bf5eb15faae0eb4a742aea4a9d0532db9684085a49750606e19

The calibration set is byte-identical across every configuration so that calibration data cannot be confounded with quantization method. c2 vs c3 isolates method (GPTQ vs AWQ) at equal bit-width, and is the study's headline control: 0.0276 vs 0.0661 pooled ASR with non-overlapping 95% CIs.

Metrics, per-prompt judge verdicts and the full report: Jeesup/safety-quant-phase0.

Downloads last month
6
Safetensors
Model size
1B params
Tensor type
I32
ยท
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Jeesup/Llama-3.2-1B-Instruct-safetyquant-c3

Quantized
(415)
this model