Llama-3.2-1B-Instruct โ configuration c3 (W4A16_ASYM)
Quantized variant used in the Safety-Aware Configuration-Conditioned LoRA study.
| field | value |
|---|---|
| scheme | W4A16_ASYM |
| method | awq |
| simulated | no โ native kernel |
| weight bits | 4 |
| activation bits | 16 |
| group / block size | 128 |
| symmetric | False |
| calibration | 512 ร 2048 tok, C4 |
| calibration sha256 | b5736155d5b24bf5eb15faae0eb4a742aea4a9d0532db9684085a49750606e19 |
The calibration set is byte-identical across every configuration so that calibration data cannot be confounded with quantization method. c2 vs c3 isolates method (GPTQ vs AWQ) at equal bit-width, and is the study's headline control: 0.0276 vs 0.0661 pooled ASR with non-overlapping 95% CIs.
Metrics, per-prompt judge verdicts and the full report: Jeesup/safety-quant-phase0.
- Downloads last month
- 6
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support
Model tree for Jeesup/Llama-3.2-1B-Instruct-safetyquant-c3
Base model
meta-llama/Llama-3.2-1B-Instruct