Configuration Parsing Warning:In UNKNOWN_FILENAME: "quantization_config.config_groups.group_0.format" must be a string
Qwen3.5-9B-MXFP4-FP8KV-CT-RTN-AutoRound
Model Details
This is a MXFP4 quantization of Qwen/Qwen3.5-9B, generated by AutoRound. Please follow the license of the original model.
Quantization Details
- Scheme: MXFP4
- Method: AutoRound
- Base model: Qwen/Qwen3.5-9B
Evaluation
| Benchmark | Score |
|---|---|
| gsm8k | 0.9227 |
| hellaswag | 0.5639 |
| mmlu | 0.7611 |
| piqa | 0.7775 |
Produced with autoquant-agent — agent-driven quantize + evaluate + self-heal.
- Downloads last month
- -