CiaraRowles commited on
Commit
888e00a
1 Parent(s): 387e381

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: unknown
3
+ ---
4
+ # Stable Video Diffusion Temporal Controlnet
5
+
6
+ ## Overview
7
+ Introducing the Stable Video Diffusion Temporal Controlnet! This tool uses a controlnet style encoder with the svd base. It's designed to enhance your video diffusion projects by providing precise temporal control.
8
+
9
+
10
+ ## Setup
11
+ - **Controlnet Model:** download the inference repo from here: https://github.com/CiaraStrawberry/sdv_controlnet
12
+ - **Installation:** run `pip install -r requirements.txt`
13
+ - **Execution:** Run "run_inference.py".
14
+
15
+ ## Demo
16
+
17
+ ![combined_with_square_image_new_gif](https://github.com/CiaraStrawberry/sdv_controlnet/assets/13116982/055c8d3b-074e-4aeb-9ddc-70d12b5504d5)
18
+
19
+ ## Notes
20
+ - **Focus on Central Object:** The system tends to extract motion features primarily from a central object and, occasionally, from the background. It's best to avoid overly complex motion or obscure objects.
21
+ - **Simplicity in Motion:** Stick to motions that svd can handle well without the controlnet. This ensures it will be able to apply the motion.
22
+
23
+ ## Acknowledgements
24
+ - **Diffusers Team:** For the svd implementation.
25
+ - **Pixeli99:** For providing a practical svd training script: [SVD_Xtend](https://github.com/pixeli99/SVD_Xtend)