born2bewild/Qwen3.8-Flash-Next-Uncensored-INT8-QEngine

Qwen3.8-Flash-Next Uncensored INT8 (QEngine)

INT8-converted checkpoint for Qwen3.8-Flash-Next, derived from orcarouter/Qwen3.8-Flash-Next-Uncensored at revision da29941aee972c7eeab497e05a292c569da1f1d6.

Compatibility warning

This checkpoint is not executable by the current QEngine: QEngine does not currently support INT8 QFN experts. The repository publishes the weights and metadata; it does not include a compatible inference implementation. No inference, quality, or performance evaluation is claimed here.

Quantization

The accompanying qfn-int8-manifest.json records the conversion: symmetric INT8, group size 128, nearest-even rounding, BF16 scales, zero point 0, RTN with per-group BF16 absmax divided by 127; zero groups use scale 1.

Files

• model.safetensors: converted model weights (130,580,392,128 bytes).
• model_mtp.safetensors: converted MTP weights (2,670,277,592 bytes).
• config.json, tokenizer files, chat template, and image/video preprocessing configs.
• qfn-int8-manifest.json: source revision and conversion details.
• LICENSE: Qwen Community License 1.0.

Download with hf download born2bewild/Qwen3.8-Flash-Next-Uncensored-INT8-QEngine --local-dir ./Qwen3.8-Flash-Next-Uncensored-INT8-QEngine. The complete checkpoint is about 133 GB; ensure sufficient disk space.

License

Use is subject to the included Qwen Community License 1.0, including its conditions for commercial products and hosted model services. Read the license before use.