Configuration Parsing Warning:In UNKNOWN_FILENAME: "quantization_config.config_groups.group_0.format" must be a string

Qwen3.5-35B-A3B-AutoRound-MXFP8

Model Details

This is a MXFP8 quantization of Qwen/Qwen3.5-35B-A3B, generated by AutoRound. Please follow the license of the original model.

Quantization Details

Evaluation

Benchmark Score
gsm8k 0.9606
hellaswag 0.8227
mmlu 0.8257
piqa 0.8264

Produced with autoquant-agent — agent-driven quantize + evaluate + self-heal.

Downloads last month
14
Safetensors
Model size
36B params
Tensor type
F8_E4M3
·
BF16
·
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for INCModel3/Qwen3.5-35B-A3B-MXFP8-CT-AutoRound

Quantized
(314)
this model