Unnamed User
commited on
Commit
•
f8223f5
1
Parent(s):
769e42a
v0.9 release
Browse files- README.md +15 -25
- loras/1600_cseti_1077723_camera-zoomin-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_1720230_camera-crane_up-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_6664682_camera-lateral_right-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_9192119_camera-zoomout-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_9213319_camera-lateral_left-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_9406077_camera-crane_down-10vid_mv2.safetensors +3 -0
- loras/2800_cseti_1093371_camera-zoomin-32f-10vid_mv2.safetensors +3 -0
README.md
CHANGED
@@ -7,7 +7,7 @@ tags:
|
|
7 |
language:
|
8 |
- en
|
9 |
---
|
10 |
-
- [Basic camera motion LoRAs](#basic-camera-motion-loras)
|
11 |
- [Model Description](#model-description)
|
12 |
- [File summary](#file-summary)
|
13 |
- [General recommendation](#general-recommendation)
|
@@ -17,27 +17,29 @@ language:
|
|
17 |
- [Walking right view](#walking-right-view)
|
18 |
- [Walking left view](#walking-left-view)
|
19 |
|
20 |
-
# Basic camera motion LoRAs
|
21 |
|
22 |
## Model Description
|
23 |
-
This repository contains a collection of motion LoRAs finetuned on Animatediff v2 models.
|
24 |
|
25 |
## File summary
|
26 |
|
27 |
-
| Name
|
28 |
-
|
|
29 |
-
|
|
30 |
-
|
|
31 |
-
|
|
32 |
-
|
|
|
|
|
|
|
|
33 |
|
34 |
|
35 |
## General recommendation
|
36 |
-
|
37 |
- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
|
38 |
-
- They work with SD 1.5
|
39 |
-
- Animatediff v3 adapter
|
40 |
-
- If you want more motion try
|
41 |
- I recommend using the above Base AR (Aspect ratio) for inference however they might work with other ARs too
|
42 |
- Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
|
43 |
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
|
@@ -45,29 +47,17 @@ This repository contains a collection of motion LoRAs finetuned on Animatediff v
|
|
45 |
## Details and examples
|
46 |
|
47 |
### Walking front view
|
48 |
-
- Recommended keywords: front-view, walking
|
49 |
-
- LoRA strength: 0.8-1.0
|
50 |
-
- scale multival / motion scale: 1.0-1.2
|
51 |
|
52 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>
|
53 |
|
54 |
### Walking back view
|
55 |
-
- Recommended keywords: back-view, walking
|
56 |
-
- LoRA strength: 0.8-1.0
|
57 |
-
- scale multival / motion scale: 1.0-1.2
|
58 |
|
59 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>
|
60 |
|
61 |
### Walking right view
|
62 |
-
- Recommended keywords: side-view, facing right, walking
|
63 |
-
- LoRA strength: 0.5-1.0
|
64 |
-
- scale multival / motion scale: 1.0-1.2
|
65 |
|
66 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>
|
67 |
|
68 |
### Walking left view
|
69 |
-
- Recommended keywords: side-view, facing left, walking
|
70 |
-
- LoRA strength: 0.5-1.0
|
71 |
-
- scale multival / motion scale: 1.0-1.2
|
72 |
|
73 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>
|
|
|
7 |
language:
|
8 |
- en
|
9 |
---
|
10 |
+
- [Basic camera motion LoRAs for Animatediff v2 motion models - version 1](#basic-camera-motion-loras-for-animatediff-v2-motion-models---version-1)
|
11 |
- [Model Description](#model-description)
|
12 |
- [File summary](#file-summary)
|
13 |
- [General recommendation](#general-recommendation)
|
|
|
17 |
- [Walking right view](#walking-right-view)
|
18 |
- [Walking left view](#walking-left-view)
|
19 |
|
20 |
+
# Basic camera motion LoRAs for Animatediff v2 motion models - version 1
|
21 |
|
22 |
## Model Description
|
23 |
+
This repository contains a collection of basic camera motion LoRAs finetuned on Animatediff v2 models. The training process utilized Kijai's [AnimateDiff Motion Director ComfyUI nodes](https://github.com/kijai/ComfyUI-ADMotionDirector). These LoRAs have been tested exclusively in ComfyUI with Kosinkadink's [AnimateDiff-Evolved nodes](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved), however they may be compatible with other AnimateDiff implementations.
|
24 |
|
25 |
## File summary
|
26 |
|
27 |
+
| Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
|
28 |
+
| ------------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
|
29 |
+
| 1600_cseti_9192119_camera-zoomout-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
30 |
+
| 1600_cseti_1077723_camera-zoomin-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
31 |
+
| 2800_cseti_1093371_camera-zoomin-32f-10vid_mv2.safetensors | v2 | (3:2) | 32 | 10 |
|
32 |
+
| 1600_cseti_6664682_camera-lateral_right-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
33 |
+
| 1600_cseti_9213319_camera-lateral_left-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
34 |
+
| 1600_cseti_9406077_camera-crane_down-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
35 |
+
| 1600_cseti_1720230_camera-crane_up-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
36 |
|
37 |
|
38 |
## General recommendation
|
|
|
39 |
- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
|
40 |
+
- They work with SD 1.5 checkpoints
|
41 |
+
- Animatediff v3 adapter LoRA is recommended regardless they are v2 models
|
42 |
+
- If you want more motion try increasing the scale multival
|
43 |
- I recommend using the above Base AR (Aspect ratio) for inference however they might work with other ARs too
|
44 |
- Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
|
45 |
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
|
|
|
47 |
## Details and examples
|
48 |
|
49 |
### Walking front view
|
|
|
|
|
|
|
50 |
|
51 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>
|
52 |
|
53 |
### Walking back view
|
|
|
|
|
|
|
54 |
|
55 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>
|
56 |
|
57 |
### Walking right view
|
|
|
|
|
|
|
58 |
|
59 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>
|
60 |
|
61 |
### Walking left view
|
|
|
|
|
|
|
62 |
|
63 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>
|
loras/1600_cseti_1077723_camera-zoomin-10vid_mv2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:388ecea81058f0ae5c995497720834203f4e9c1d270b0472aa7509389e237bae
|
3 |
+
size 118348392
|
loras/1600_cseti_1720230_camera-crane_up-10vid_mv2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b5cdb3dc07c64d1baaa288c2cc7747cbcfae61a1276632b5e89aead7257764ab
|
3 |
+
size 118348392
|
loras/1600_cseti_6664682_camera-lateral_right-10vid_mv2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c3d18d62579d78440baea16c97861b071831c3e98282fe2cd06eb0970022846e
|
3 |
+
size 118348392
|
loras/1600_cseti_9192119_camera-zoomout-10vid_mv2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:eeecc684ed8a2abf7051067a9ab2de2e602586e8f7eaf651ed5ea1738555f7e8
|
3 |
+
size 118348392
|
loras/1600_cseti_9213319_camera-lateral_left-10vid_mv2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f7c660048062a0d87ea05832439a4ed5c85ea9de8127e2132d0d07ac12faee26
|
3 |
+
size 118348392
|
loras/1600_cseti_9406077_camera-crane_down-10vid_mv2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e538b0ad4848fd27240edccf28ace73d5d54949da74a44dcb70738c3a31479f8
|
3 |
+
size 118348392
|
loras/2800_cseti_1093371_camera-zoomin-32f-10vid_mv2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:693651ab6a8fb20fcf85339cbebd41650458e1d2fbb4e5af4ec1f13a06bd8a2d
|
3 |
+
size 118348392
|