yhyu13 commited on
Commit
53f6501
1 Parent(s): bd08302
README.md CHANGED
@@ -1,3 +1,37 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+
5
+ This is the community upoloaded repository for LoRA weights for the MotionDirector project. https://github.com/showlab/MotionDirector.git
6
+
7
+ Weights originally come from [Google Drive](https://drive.google.com/drive/folders/15anLJAkX1UplkPzpU1yLm-W7XoaFTCxp?usp=sharing) mentioned in the MotionDirector project readme.
8
+
9
+ Clone the repo as follows:
10
+
11
+ ```
12
+ git lfs clone --depth 1 --single-branch --branch main https://huggingface.co/Yhyu13/MotionDirector_LoRA.git ./outputs
13
+ ```
14
+
15
+ After installing dependencies, run the following command to generate a.mp4 video:
16
+
17
+
18
+ ```
19
+ #!/bin/bash
20
+
21
+ eval "$(conda shell.bash hook)"
22
+ conda activate motiondirector
23
+
24
+ MODEL_PATH=./models/zeroscope_v2_576w
25
+ PROMPT="A person is riding a bicycle past the Eiffel Tower."
26
+ python MotionDirector_inference.py \
27
+ --model $MODEL_PATH \
28
+ --prompt "$PROMPT" \
29
+ --checkpoint_folder ./outputs/train/train_2023-12-02T13-39-36/ \
30
+ --checkpoint_index 300 \
31
+ --noise_prior 0. \
32
+ --seed 7192280 | tee ./local_log.log
33
+ ```
34
+
35
+ The generated .mp4 is then stored under inference directory
36
+
37
+ [./inference/A_person_is_riding_a_bicycle_past_the_Eiffel_Tower.mp4](./inference/A_person_is_riding_a_bicycle_past_the_Eiffel_Tower.mp4)
inference/A_person_is_riding_a_bicycle_past_the_Eiffel_Tower_7192280.mp4 ADDED
Binary file (262 kB). View file
 
train/train_2023-12-02T13-39-36/cached_latents/cached_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a61d6c8c90ffc4ce9310bf0831c88b9efe166523b88b16320196a37f0d97e4cf
3
+ size 19073000
train/train_2023-12-02T13-39-36/cached_latents/cached_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3974bb74783ca984d7e1feac8a193c6329332343122c19b8a0e5217b01de1ae
3
+ size 19073000
train/train_2023-12-02T13-39-36/cached_latents/cached_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6207c9b760b5232d2cf56efae7decbb38cb2f78222b29b948e3e61cf10a61b2b
3
+ size 19073000
train/train_2023-12-02T13-39-36/cached_latents/cached_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25f01471da713e1d678e49e7adf3726a651cc552546babcc1d5dc03daa3ef44a
3
+ size 19073000
train/train_2023-12-02T13-39-36/checkpoint-300/spatial/lora/300_unet.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b01bff47199e034118bd6dbd1363115fac83fe06691a0ed25297e4cff98c65bd
3
+ size 140799939
train/train_2023-12-02T13-39-36/checkpoint-300/temporal/lora/300_unet.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e70dfbf5b507f86315b2f08e751262affe5604997a048f9f93f762d6525fc30b
3
+ size 49988719
train/train_2023-12-02T14-12-09/cached_latents/cached_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d222cb84aa80b18ed51aa9a1bd0193ee3932dc08cbbb4dc2ae13a93ac1c594c
3
+ size 28903717
train/train_2023-12-02T14-12-09/checkpoint-150/spatial/lora/150_unet.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9acae3f89cb2d9269ba71a1f9ec458d7d449ca2e00029ab62fb8f2aa51f37276
3
+ size 35199683
train/train_2023-12-02T14-12-09/checkpoint-150/temporal/lora/150_unet.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4084da274cff38dad6afcd1c4fb5dadf2cf8598ecc34f0a98f0e1ac353357fcf
3
+ size 49988719
train/train_2023-12-02T19-37-22/cached_latents/cached_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84f8a436bd55bf7a4f67d6f8a9bb5ff4d7681651d1850968df7ffbe04b478177
3
+ size 54192421
train/train_2023-12-02T19-37-22/checkpoint-150/spatial/lora/150_unet.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5536870d9484c2ab1cf57c5977b22998f4eb5cd164be186bbfcbb7e7b655281f
3
+ size 35199683
train/train_2023-12-02T19-37-22/checkpoint-150/temporal/lora/150_unet.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aeea25720ce0781d8b7dae044e9920121933c2e9f112891f37ae84aa64ed721e
3
+ size 49988719