AnimateDiff 3D in ComfyUI.  Convert your 2D cartoons into 3D  #stablediffusion #comfyui
Channel: Koala Nation
Date: 05/04/2024

In this workflow we show you the possibilities of using RAVE to convert 2D cartoons into 3D looking style animations. Using ComfyUI and AnimateDiff, in combination with the RAVE sampler and denoising, it is possible to transform a complete 2D sequence and achieve great 3D consistency. Best way to do comfyui video to animation in 3D.

This is not a comfyui 3D render, as there is not 3D mesh created, but makes a great 3D effect, which you can later improve with a second pass (for example using SDXL).



#animatediff #comfyui #stablediffusion 
============================================================
💪 Support this channel with a Super Thanks or a ko-fi! https://ko-fi.com/koalanation
☕ Amazing ComfyUI workflows: https://tinyurl.com/y9v2776r

🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. https://tinyurl.com/58x2bpp5 🤗

☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
👉 RunDiffusion: https://tinyurl.com/ypp84xjp  👉15% off first month with code 'koala15'
👉 ThinkDiffusion: https://tinyurl.com/4nh2yyen

🤑🤑🤑 FREE! Check my runnable workflows in OpenArt.ai: https://tinyurl.com/3j4z6xwf
============================================================



👉Final workflow (in OpenArt): https://tinyurl.com/3rj2kkxh
👉Download the video template in: https://tinyurl.com/5xw4vn57

🔖Chapters
============================================================
00:00 Intro
00:21 Preparation: downloading video, workflow, running in OpenArt.ai and steps guide
01:54 Step 1: Video and models settings, selection of the keyframe
04:21 Step 2: Keyframe 2D to 3D. Explanation how to fine tune workflow settings
09:50 Step 2: General guidelines for tuning
10:15 Step 3: Testing the keyframe and settings for a short set of frames (10-32)
11:42 Step 4: Rendering the complete animation and how to do final corrections
13:19 Promos
14:05 Outro

🧶Custom Nodes:
============================================================
Can all be installed with ComfyUI Manager (http://tinyurl.com/ms3jkk4m)
➡️ Impact Pack
➡️ ControlNet Auxiliary Preprocessors
➡️ (cubiq) IP Adapter plus
➡️ Advanced-Controlnet
➡️ AnimateDiff Evolved
➡️ VideoHelper Suite
➡️ rgthree comfyUI nodes
➡️ KJNodes for comfyUI
➡️ RAVE
➡️ Crystools

👩‍🔬Checkpoints (copy in models/checkpoints)
==========================================================
➡️ Juggernaut: https://tinyurl.com/2jvruwne
➡️ 3D Cartoon Vision: https://tinyurl.com/t7cbzya9

🚨 ControlNet (copy in models/controlnet folder)
==========================================================
➡️ Lineart
➡️ Depth
➡️ T2I Adapter Color
➡️ ControlGIF (hugginface): http://tinyurl.com/28y9jkkr

🎥 AnimateDiff 
=========================================================
➡️ Version 3 Motion module
➡️ Version 3 Lora adapter

🎥 IP Adapter (gen. 2)
=========================================================
➡️ IP Adapter Plus

CREDITS
=========================================================
📺 Videos
Viddezzy: https://tinyurl.com/5xw4vn57

🎵Music
Song: Bike Box, Artist: Kia, Music by: CreatorMix.com
Song: Ice Cream Truck, Artist: Kia, Music by: CreatorMix.com
Song: Trinity, Artist: Kia, Music by: CreatorMix.com
Song: Doughnuts, Artist: Kia, Music by: CreatorMix.com
Song: Avatar, Artist: Kia, Music by: CreatorMix.com
Song: Spring, Artist: Kia, Music by: CreatorMix.com
Song: Deep Emotion, Artist: Soul, Music by: CreatorMix.com


✂️ Edited with Canva, and ClipChamp. I record the stuff in powerpoint.
========================================================
© 2024 Koala Nation 
#comfyui #animatediff #stablediffusion