Instructions to use MiniMaxAI/MiniMax-H3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use MiniMaxAI/MiniMax-H3 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MiniMaxAI/MiniMax-H3", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Inference
- Notebooks
- Google Colab
- Kaggle
MiniMax H3 Ref2VA + audio recasts identity, while FL2VA + Ref2V Turbo preserves it β expected behavior?
I am testing MiniMax H3 with one human identity reference and a short speech-audio reference.
The same visual reference preserves identity reasonably well through ImageToVideo/FL2VA, but identity collapses when the reference is supplied through ReferenceToVideo together with audio.
Common setup
- Resolution: 1344x768
- FPS: 24
- Length: 124 frames / 5.17 seconds
- Euler sampler
- Beta scheduler
- Same source image
- Same structured reference prompt
- InsightFace
buffalo_lcosine similarity used for diagnostics
Test A β ImageToVideo, visual only
- FL2VA checkpoint
- Ref2V Turbo LoRA
- ImageToVideo
- 8 steps
- No audio
Results:
- Mean similarity:
0.8855 - Minimum similarity:
0.8628
The identity is visually preserved.
Test B β ReferenceToVideo with audio, ref_image_size=match
- Same checkpoint
- Same Ref2V Turbo LoRA
- ReferenceToVideo
- One image reference
- One audio reference
- 8 steps
Results:
- Mean similarity:
0.0884 - Minimum similarity:
0.0328
The output is effectively a different person.
Test C β ReferenceToVideo with audio, ref_image_size=max
Only the image sizing mode was changed.
Results:
- Mean similarity:
0.0902 - Minimum similarity:
0.0527
Changing match to max does not recover the identity.
Test D β Native Ref2VA without LoRA
- Native Ref2VA checkpoint
- No LoRA
- ReferenceToVideo
- Audio reference
- 18 steps
ref_image_size=max
Results:
- Mean similarity:
0.0669 - Minimum similarity:
0.0350
Using the native checkpoint and more steps still produces the wrong identity.
Observation
The failure appears to be specifically associated with audio conditioning through the ReferenceToVideo path.
ImageToVideo/FL2VA preserves the identity much better with the same visual reference, while ReferenceToVideo with audio recasts the subject.
The following did not solve the problem:
- changing
matchtomax; - removing the Turbo LoRA;
- increasing the number of steps to 18;
- using the native Ref2VA checkpoint.
Questions
- Is this a known limitation of the current audio-conditioned ReferenceToVideo path?
- Is the Ref2V Turbo LoRA intended for visual reference conditioning only?
- Is there a recommended workflow for combining:
- a fixed first-frame identity;
- a separate image reference;
- audio or lip synchronization?
- Should audio be connected through the FL2VA/ImageToVideo path instead?
- Are there recommended audio-shift, VAE, attention or sampler settings for preserving identity?
- Could this be caused by an incorrect ComfyUI node connection?