yhyu13
commited on
Commit
•
53f6501
1
Parent(s):
bd08302
Upload
Browse files- README.md +34 -0
- inference/A_person_is_riding_a_bicycle_past_the_Eiffel_Tower_7192280.mp4 +0 -0
- train/train_2023-12-02T13-39-36/cached_latents/cached_0.pt +3 -0
- train/train_2023-12-02T13-39-36/cached_latents/cached_1.pt +3 -0
- train/train_2023-12-02T13-39-36/cached_latents/cached_2.pt +3 -0
- train/train_2023-12-02T13-39-36/cached_latents/cached_3.pt +3 -0
- train/train_2023-12-02T13-39-36/checkpoint-300/spatial/lora/300_unet.pt +3 -0
- train/train_2023-12-02T13-39-36/checkpoint-300/temporal/lora/300_unet.pt +3 -0
- train/train_2023-12-02T14-12-09/cached_latents/cached_0.pt +3 -0
- train/train_2023-12-02T14-12-09/checkpoint-150/spatial/lora/150_unet.pt +3 -0
- train/train_2023-12-02T14-12-09/checkpoint-150/temporal/lora/150_unet.pt +3 -0
- train/train_2023-12-02T19-37-22/cached_latents/cached_0.pt +3 -0
- train/train_2023-12-02T19-37-22/checkpoint-150/spatial/lora/150_unet.pt +3 -0
- train/train_2023-12-02T19-37-22/checkpoint-150/temporal/lora/150_unet.pt +3 -0
README.md
CHANGED
@@ -1,3 +1,37 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
+
|
5 |
+
This is the community upoloaded repository for LoRA weights for the MotionDirector project. https://github.com/showlab/MotionDirector.git
|
6 |
+
|
7 |
+
Weights originally come from [Google Drive](https://drive.google.com/drive/folders/15anLJAkX1UplkPzpU1yLm-W7XoaFTCxp?usp=sharing) mentioned in the MotionDirector project readme.
|
8 |
+
|
9 |
+
Clone the repo as follows:
|
10 |
+
|
11 |
+
```
|
12 |
+
git lfs clone --depth 1 --single-branch --branch main https://huggingface.co/Yhyu13/MotionDirector_LoRA.git ./outputs
|
13 |
+
```
|
14 |
+
|
15 |
+
After installing dependencies, run the following command to generate a.mp4 video:
|
16 |
+
|
17 |
+
|
18 |
+
```
|
19 |
+
#!/bin/bash
|
20 |
+
|
21 |
+
eval "$(conda shell.bash hook)"
|
22 |
+
conda activate motiondirector
|
23 |
+
|
24 |
+
MODEL_PATH=./models/zeroscope_v2_576w
|
25 |
+
PROMPT="A person is riding a bicycle past the Eiffel Tower."
|
26 |
+
python MotionDirector_inference.py \
|
27 |
+
--model $MODEL_PATH \
|
28 |
+
--prompt "$PROMPT" \
|
29 |
+
--checkpoint_folder ./outputs/train/train_2023-12-02T13-39-36/ \
|
30 |
+
--checkpoint_index 300 \
|
31 |
+
--noise_prior 0. \
|
32 |
+
--seed 7192280 | tee ./local_log.log
|
33 |
+
```
|
34 |
+
|
35 |
+
The generated .mp4 is then stored under inference directory
|
36 |
+
|
37 |
+
[./inference/A_person_is_riding_a_bicycle_past_the_Eiffel_Tower.mp4](./inference/A_person_is_riding_a_bicycle_past_the_Eiffel_Tower.mp4)
|
inference/A_person_is_riding_a_bicycle_past_the_Eiffel_Tower_7192280.mp4
ADDED
Binary file (262 kB). View file
|
|
train/train_2023-12-02T13-39-36/cached_latents/cached_0.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a61d6c8c90ffc4ce9310bf0831c88b9efe166523b88b16320196a37f0d97e4cf
|
3 |
+
size 19073000
|
train/train_2023-12-02T13-39-36/cached_latents/cached_1.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a3974bb74783ca984d7e1feac8a193c6329332343122c19b8a0e5217b01de1ae
|
3 |
+
size 19073000
|
train/train_2023-12-02T13-39-36/cached_latents/cached_2.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6207c9b760b5232d2cf56efae7decbb38cb2f78222b29b948e3e61cf10a61b2b
|
3 |
+
size 19073000
|
train/train_2023-12-02T13-39-36/cached_latents/cached_3.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:25f01471da713e1d678e49e7adf3726a651cc552546babcc1d5dc03daa3ef44a
|
3 |
+
size 19073000
|
train/train_2023-12-02T13-39-36/checkpoint-300/spatial/lora/300_unet.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b01bff47199e034118bd6dbd1363115fac83fe06691a0ed25297e4cff98c65bd
|
3 |
+
size 140799939
|
train/train_2023-12-02T13-39-36/checkpoint-300/temporal/lora/300_unet.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e70dfbf5b507f86315b2f08e751262affe5604997a048f9f93f762d6525fc30b
|
3 |
+
size 49988719
|
train/train_2023-12-02T14-12-09/cached_latents/cached_0.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9d222cb84aa80b18ed51aa9a1bd0193ee3932dc08cbbb4dc2ae13a93ac1c594c
|
3 |
+
size 28903717
|
train/train_2023-12-02T14-12-09/checkpoint-150/spatial/lora/150_unet.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9acae3f89cb2d9269ba71a1f9ec458d7d449ca2e00029ab62fb8f2aa51f37276
|
3 |
+
size 35199683
|
train/train_2023-12-02T14-12-09/checkpoint-150/temporal/lora/150_unet.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4084da274cff38dad6afcd1c4fb5dadf2cf8598ecc34f0a98f0e1ac353357fcf
|
3 |
+
size 49988719
|
train/train_2023-12-02T19-37-22/cached_latents/cached_0.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:84f8a436bd55bf7a4f67d6f8a9bb5ff4d7681651d1850968df7ffbe04b478177
|
3 |
+
size 54192421
|
train/train_2023-12-02T19-37-22/checkpoint-150/spatial/lora/150_unet.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5536870d9484c2ab1cf57c5977b22998f4eb5cd164be186bbfcbb7e7b655281f
|
3 |
+
size 35199683
|
train/train_2023-12-02T19-37-22/checkpoint-150/temporal/lora/150_unet.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:aeea25720ce0781d8b7dae044e9920121933c2e9f112891f37ae84aa64ed721e
|
3 |
+
size 49988719
|