Workflow - V2V shot-to-shot transition between two videos with Systms-FLW-IC-Lora

#147
by RuneXX - opened

V2V shot-to-shot transition between two videos with Systms-FLW-IC-Lora

Make creative or smooth transition between two video clips.
A smooth continuous video between two similar videos, or "warping" transitions between two different videos... up to you ;-)
Uses reference frames from both videos (with audio) to create a continuous feel.
The transition length can be set in the workflow. Something around 3 to 10 seconds should work well.

The prompting is important. Prompt both for what scene and subject changes you want to happen, as well as the audio sounds for the transitions. Optionally you can also use audio file, as custom audio, for the transition part. The workflow also has a prompt enhancer with instruction to generate a transition between the last frame of video a and first frame of video b, should you want to use that (optional)

Might take a few runs to get something you like, play around with the prompt and seed.
The workflow both outputs only the transition (so you can use in a video editor to merge with scene a and b), as well as the full video from a to b.

The lora can be found here: https://huggingface.co/systms/SYSTMS-FLW-IC-LORA-LTX-2.3

The workflow is a bit work in progress, since its a lot of spaghetti noodles under the hood, so might come some updates to the wf if needed ;-) But should work fine

Feel free to try it out:
https://huggingface.co/RuneXX/LTX-2.3-Workflows/tree/main/Video-2-Video

Sign up or log in to comment