Instructions to use drozbay/Wan2.2-S2V-14B-module with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Wan2.2
How to use drozbay/Wan2.2-S2V-14B-module with Wan2.2:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Wan2.2 S2V 14B β Module (ComfyUI)
The S2V-specific layers of Wan2.2-S2V-14B as a
standalone module: 165 tensors, 4.01 GB bf16 (audio_injector, casual_audio_encoder,
cond_encoder, frame_packer, trainable_cond_mask), bit-exact from the official weights.
Stack it onto any 16-channel Wan 14B T2V-style trunk (Wan2.1/2.2 T2V, finetunes like Bernini-R) and ComfyUI detects the result as an S2V model β audio lip-sync, reference image, and control video on whatever trunk you pick, no baked 32 GB checkpoints needed.
Usage
- Put
wan22_s2v_module_bf16.safetensorsinComfyUI/models/diffusion_models/. - Load with KJNodes DiffusionModelLoaderKJ:
trunk as the model, the module via
extra_state_dict(use DiffusionModelSelector). - Condition with the native WanSoundImageToVideo node (needs a
wav2vec2
audio encoder in
models/audio_encoders/).
Bernini trunks: to keep BerniniConditioning working in S2V mode, save
wan_s2v_module_patch.py into ComfyUI/custom_nodes/ and insert the
Wan S2V-Bernini Patch node after the loader. Chain WanSoundImageToVideo β BerniniConditioning
for audio + in-context refs together.
Notes: the injectors were trained against the S2V trunk (closest to Wan2.2 low-noise / Wan2.1), so expect the weakest results on high-noise experts and heavy finetunes. I2V trunks (36-channel) are not compatible.
Credits
- Wan2.2 β Alibaba
- Approach reverse-engineered from rzgar/Bernini-R-S2V
- Extraction and node built with Claude (Claude Fable 5)
- Downloads last month
- -
Model tree for drozbay/Wan2.2-S2V-14B-module
Base model
Wan-AI/Wan2.2-S2V-14B