Instructions to use lightx2v/Minimax-h3-Turbo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use lightx2v/Minimax-h3-Turbo with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("lightx2v/Minimax-h3-Turbo", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
motion issues
I know some will say oh motion is fine but trust me its not, all the lora makers right now have the same issue the motion is being killed, having said that if you download minimax_h3_fl2v_lightx2v_turbo_4step_v0.1_comfy_resized_avg_rank_21_bf16.safetensors by kajai and run that in addition to this lora the motion fluidity returns. I'm not sure what he's doing but that file fixes that crap motion.
much better after using minimax_h3_fl2v_lightx2v_turbo_4step_v0.1_comfy_resized_avg_rank_21_bf16.safetensors
we need a v1.0 version resized avg rank 21 lora
I know some will say oh motion is fine but trust me its not, all the lora makers right now have the same issue the motion is being killed, having said that if you download minimax_h3_fl2v_lightx2v_turbo_4step_v0.1_comfy_resized_avg_rank_21_bf16.safetensors by kajai and run that in addition to this lora the motion fluidity returns. I'm not sure what he's doing but that file fixes that crap motion.
I know some will say oh motion is fine but trust me its not, all the lora makers right now have the same issue the motion is being killed, having said that if you download minimax_h3_fl2v_lightx2v_turbo_4step_v0.1_comfy_resized_avg_rank_21_bf16.safetensors by kajai and run that in addition to this lora the motion fluidity returns. I'm not sure what he's doing but that file fixes that crap motion.
i believe you, i've noticed the same thing, but could you tell me at what strengths do you use them when you mix them to get the best results?
https://huggingface.co/drbaph/MiniMax-H3-Turbo-Lora-ComfyUI/blob/main/minimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_resized_avg_rank_21_bf16.safetensors
A new issue has arisen: usingminimax_h3_fl2v_turbo_4step_v1.0_768p_comfyui_resized_avg_rank_21_bf16.safetensorsresults in abnormal audio generation, whereas usingminimax_h3_fl2v_lightx2v_turbo_4step_v0.1_comfy_resized_avg_rank_21_bf16.safetensorscauses changes in how the generated video adheres to the prompts.
i believe you, i've noticed the same thing, but could you tell me at what strengths do you use them when you mix them to get the best results?
Before with kaijis version i used to just limit the main lighting lora but now with this one it looks like we have to limit the rank lora or we get disney style over the top animation, im still trying to finetune whats perfect but starting at 0.3- 0.5 for str for the rank lora is a good starting point
I know some will say oh motion is fine but trust me its not, all the lora makers right now have the same issue the motion is being killed, having said that if you download minimax_h3_fl2v_lightx2v_turbo_4step_v0.1_comfy_resized_avg_rank_21_bf16.safetensors by kajai and run that in addition to this lora the motion fluidity returns. I'm not sure what he's doing but that file fixes that crap motion.
you mean run two turbo lora to fix motion? What is the lora strength