Hybrid-Sensitivity-Weighted-Quantization (HSWQ)
High-fidelity INT8 quantization for diffusion models (SDXL). HSWQ uses sensitivity and importance analysis instead of naive uniform cast.
Technical details: md/HSWQ_INT8_SDXL_Technical_Guide.md
How to quantize: md/HSWQ_ How to quantize SDXL.md
ComfyUI Loader for INT8: To load these INT8 models in ComfyUI, please use the unofficial loader node: ComfyUI-nunchaku-unofficial-loader
SDXL Benchmark Test Results: test/benchmark_sdxl_int8.md
Benchmark (Reference)
| Model | SSIM (Avg) | File size | Compatibility |
|---|---|---|---|
| Original FP16 | 1.0000 | 100% | High |
| Naive INT8 | 0.91-0.96 | 50% | High |
| HSWQ INT8 | 0.94-0.98 | 67% (FP16 mixed) | High |
π¦ Available Models
| Filename | Base Model | Version | License |
|---|---|---|---|
waiIllustriousSDXL_v170_hswq_r32_r0_int8.safetensors |
Illustrious-XL v1.7 (WAI-illustrious-SDXL) | v17.0 (HF weight) | Illustrious License |
prefectIllustriousXL_v8_hswq_r32_r0_int8.safetensors |
Prefect illustrious XL | v8.0 | Illustrious License |
JANKUTrainedChenkinNoobai_v777_hswq_r32_r0_int8.safetensors |
JANKU Trained Chenkin & Noobai-Rouwei (Illustrious-XL) | v777 | Illustrious License |
unholyDesireMixSinister_v80_hswq_r32_r0_int8.safetensors |
Unholy Desire Mix - Sinister Aesthetic (Illustrious) | v8.0 | Illustrious License |
waiANIPONYXL_v140_hswq_r32_r0_int8.safetensors |
WAI-ANI-PONYXL | v14.0 | Pony License |
novaAnimeXL_ilV190_hswq_r32_r0_int8.safetensors |
Nova Anime XL | Illustrious v19.0 | Illustrious License |
bluePencilXL_v031_hswq_r32_r0_int8.safetensors |
blue_pencil-XL | v0.3.1 | CreativeML Open RAIL++-M |
π Credits & License
π Special Acknowledgement
We extend our deepest respect and gratitude to the Nunchaku Team for their groundbreaking work on SVDQ quantization and for sharing their models with the community. This collection relies heavily on their research and original implementation.
- Original Repository: nunchaku-tech/nunchaku-sdxl
Base Models
These models are derivatives of their respective creators. All credit for aesthetic tuning and model training belongs to the original creators.
- WAI-illustrious-SDXL / WAI-ANI-PONYXL: Created by WAI0731.
- Prefect illustrious XL: Created by Goofy_Ai.
- JANKU Trained Chenkin & Noobai-Rouwei (Illustrious-XL): Created by janxd.
- Unholy Desire Mix - Sinister Aesthetic (Illustrious): Created by UnholyDesiresStudio.
- Nova Anime XL: Created by Crody.