Forge Neo Image 2.1 Turbo INT8

Built with Qwen. This is an unofficial INT8 conversion of Qwen Image 2.1 Turbo for Aikimi Forge Neo. Qwen supplies the source weights; Aikimi supplies this quantized conversion. No additional training was performed. Read LICENSE and NOTICE.md: use and redistribution are limited to non-commercial research or evaluation under the Qwen Research License.

Contents and provenance

This repository contains the quantized generation Transformer and shared Qwen3-VL text encoder, plus an integrity manifest and importer. It is not a complete image pipeline. The VAE, processor, official sampling configuration, and original BF16 model files are supplied by Neo's setup.

Model weights use the Qwen Research LICENSE. The included importer source code uses AGPLv3; see CODE_LICENSE.

  • Transformer source: Qwen/Qwen-Image-2.1-Turbo revision d65dbc9a7e8f6b5479e33dee6030eaab2a906509.
  • Shared encoder source: Qwen/Qwen-Image-2.1 revision b3179ad355be050328e483a9dfdd9e60cd62adfa. Its source tensor values match the encoder bundled with the official Turbo checkpoint.
  • Sampling: the official eight sigma values, CFG 1, and FlowMatchEulerDiscreteScheduler with dynamic shifting disabled.

The saved components use Diffusers/Transformers bitsandbytes INT8 save_pretrained formats. Selected input, modulation, normalization, time embedding, and output modules retain source precision.

The conversion changes the selected Linear weights in transformer/ and text_encoder/. Config files are sanitized to remove machine-local paths. Each safetensors header and JSON component file carries a modification notice identifying Aikimi's conversion and its source revision. Adding these notices preserves every tensor descriptor, offset, and raw tensor byte from the saved conversion. The individual converted files, original source revisions and SHA-256 values, conversion recipes, runtime versions, and exported file hashes are listed in release_manifest.json. The original local complete.json and cache paths are not distributed.

Install in Forge Neo

Neo currently requires its pinned official BF16 source files to remain installed. These files avoid GPU quantization before inference; they do not remove the source-model download or replace the original weights.

Close Neo and run from the Neo checkout root in PowerShell:

.\aikimi-qwen-image21-setup.bat --official-turbo-only
& .\models\Qwen-Image-2.1\worker-env\Scripts\hf.exe download Aikimi/Forge-Neo-Image-2.1-Turbo-INT8 --local-dir .\work\hf-models\official-turbo-int8
& .\models\Qwen-Image-2.1\worker-env\Scripts\python.exe -X utf8 tools\qwen21_hub_release.py install --precision turbo_official_int8 --release-dir .\work\hf-models\official-turbo-int8

Select 公式Turbo · INT8 · 推奨8 steps in Qwen Image 2.1 Studio. The importer checks both components' source identities, recipes and runtime versions, then verifies each component's payload hashes before installing that component. It creates a local cache manifest bound to the receiving machine. An existing valid component is verified and retained. If runtime versions differ, prepare a conversion locally in that environment.

Neo v3.9.1 and later accepts any positive step count. Eight steps uses the official schedule; other counts use a native FlowMatch schedule. Recommendations appear as non-blocking notifications.

CUDA with BF16 support is required. The versions and quantization recipe recorded in the manifest are part of this release's format. Neo's isolated runtime provides its required loader and CPU-offload handling.

Verification

The source INT8 components used for this export passed CUDA text-to-image and reference-editing runs at 768 by 768, native Outpaint at 832 by 832, and a reload run. All runs recorded the eight official timesteps; the original and reloaded text-to-image outputs had identical pixel hashes. All saved component files passed SHA-256 verification before export. These checks cover the tested settings, not general quality parity with BF16.

Tested on an NVIDIA RTX 3090 with 24 GB VRAM, driver 610.74, and PyTorch 2.13.0+cu130. The complete runtime versions are recorded in the manifest.

Limits

Quantization changes numeric values and can affect composition, text, colors and details. This release does not claim pixel or quality parity with BF16. Additional LoRA, ControlNet, Outpaint and Sparse combinations have their own limits in Neo's Turbo guide.

日本語: Neo向けの非公式量子化配布です。公式Turbo本体・共通部品・専用環境を先に導入し、保存済みTransformerとテキストエンコーダーを取り込むと、推論前のGPU変換を省けます。元BF16の保存は必要です。研究・評価用途のライセンスと、manifestに記録した専用環境の条件を確認してください。

Downloads last month
-
Safetensors
Model size
7B params
Tensor type
F32
·
BF16
·
I8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Aikimi/Forge-Neo-Image-2.1-Turbo-INT8

Quantized
(44)
this model