Instructions to use rzgar/minimax-h3_ref2va_8Step_motion_enhancer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use rzgar/minimax-h3_ref2va_8Step_motion_enhancer with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MiniMaxAI/MiniMax-H3", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("rzgar/minimax-h3_ref2va_8Step_motion_enhancer") prompt = "A man with short gray hair plays a red electric guitar." input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") image = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
motion enhancer lora only
hi, i tried this lora, result very good, thanks . but size a little too large. can you provide a motion enhancer lora only without merging the 8 step turbo . for example minimax_h3_ref2v_lightx2v_turbo_4step_v0.1_resized_avg_rank_20_bf16 from kj is only 300M.
Hi,
The small file size is explained by the filename: it's *_avg_rank_20, an SVD rank-reduced version of a rank-128 lora. u can run a per parameter SVD
rank reduction to produce a similarly small file.
about merging loras: it doesn't work that way or at least I don't do it that way. Merging other LoRAs into a distilled 8step lora breaks the distillation,
and the result is noisy video. I learned that with Wan 2.2, so I never tried it again. It may work with some videos and fail with others
but I hear what you're saying. I'll try to make a general NSFW lora that can be used without the distilled lora I'll work on that.
Thanks ,looking forward. i thought you merged it manually, i am not an ai expert, just a player😄.
I use kj's script to convert , but only got minimax-h3_ref2va_8Step_motion_enhancer_resized_from_384_to_dynamic_7_bf16. nomatter what i set from 20 to 128 to 384 , only got 7 rank . 7 has some body problem , too low i think