Can you explain a bit about what this controlnet is doing?
I use it, its magical, giving great results! I also cannot wait for the SDXL version :)
but what does it do exactly and what are some tips and settings that are recommended by you?
does it behave like the tile controlnet?
Thanks for your attention, the SDXL version I am still working on. This controlnet is specifically finetuned for animatediff whose purpose is to keep the initial image appearance in the process of animation. It performance is unstable when compared to the tile controlnet, because the train dataset is less than tile controlnet. When you use it for animation, I recommend you use the less motion version for its stable performance.
Please provide at least some description.
Add video fragments, GIFs to understand what type of animation this ControlNet can do
Please add step-by-step instructions on how to reproduce at least a simple example.
Thank you.