Any-to-Any
English
ltx-video
image-to-video
text-to-video

Workflow to use Control Union + Custom Audio

#5
by Alberfer - opened

I have been using control union with pose workflows it works great but i was wondering if there is a workflow to add a custom audio to the process so video can use it for lipsync too. thanks

Adding custom audio is just encoding the audio you want into latent, then use the set latent noise mask node to set a mask. Use solid mask 16px by 16px set at 0. This will pass the audio in and not change it. It will then sync the subject if there is one or it will use the audio to help drive the video generation.

Sign up or log in to comment