jajmangold/Wan2.2-I2V-A14B-Diffusers-fni8

Wan2.2-I2V-A14B-Diffusers — fni8 (int4)

An int8/int4 quantization of Wan-AI/Wan2.2-I2V-A14B-Diffusers to the .fni8 format, for the fni8 DP4A kernels on NVIDIA Volta (sm_70) GPUs (Tesla V100 and CMP 100-210). It is a derivative of the parent model; its license and acceptable uses follow the parent, linked above.

Files

file	precision	scheme	size
Wan-AI__Wan2.2-I2V-A14B-Diffusers.dit.b4.fni8	int4	int4 per-group W4A8 (int8 activations)	7.94 GB

.b8. files are int8, .b4. files are int4. Download the one you want. The bytes are the resident dp4a VRAM layout, so loading is a memory-map and copy with no dequantize or repack step.

How to use

Load with ComfyUI-fni8, which runs the diffusion transformer through the dp4a kernels inside ComfyUI (UnetLoaderFNI8). The text encoder and VAE are unchanged.

What was quantized

• Linear and attention weights go to int8 (per-row) or int4 (per-group), with fp32 scales. Norms, embeddings, and the MoE router are kept in fp16.
• Source dtype: float16. Non-quantized tensors are stored fp16, upcast to fp32 only where fp16 would overflow.
• Target hardware is sm_70, where the fp16 tensor cores are firmware-limited, so the integer __dp4a path is used for the matmuls.

Intended use and scope

• For inference with the fni8 runtimes above, on Volta (sm_70) GPUs.
• Out of scope: other GPU architectures (the kernels require sm_70), and anything the parent model's license does not permit. It is a derivative, not a new model.

Limitations

• Quantization is lossy. int8 and especially int4 outputs differ from the fp16/bf16 parent, and the difference varies by model and task.
• This repository does not include per-model accuracy or benchmark measurements. Evaluate on your own task before relying on it.
• Any capabilities, biases, and risks of the parent model carry over. See the parent model card for those.

License

Follows the parent model (apache-2.0). This is a derivative quantization, not a relicense.

---

Part of the fni8 stack: kernels · LLM serving · ComfyUI DiTs.