File size: 1,218 Bytes
bd08302
 
 
53f6501
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
---
license: apache-2.0
---

This is the community upoloaded repository for LoRA weights for the MotionDirector project. https://github.com/showlab/MotionDirector.git

Weights originally come from [Google Drive](https://drive.google.com/drive/folders/15anLJAkX1UplkPzpU1yLm-W7XoaFTCxp?usp=sharing) mentioned in the MotionDirector project readme.

Clone the repo as follows:

```
git lfs clone --depth 1 --single-branch --branch main https://huggingface.co/Yhyu13/MotionDirector_LoRA.git ./outputs
```

After installing dependencies, run the following command to generate a.mp4 video:


```
#!/bin/bash

eval "$(conda shell.bash hook)"
conda activate motiondirector

MODEL_PATH=./models/zeroscope_v2_576w
PROMPT="A person is riding a bicycle past the Eiffel Tower."
python MotionDirector_inference.py \
    --model $MODEL_PATH  \
    --prompt "$PROMPT" \
    --checkpoint_folder ./outputs/train/train_2023-12-02T13-39-36/ \
    --checkpoint_index 300 \
    --noise_prior 0. \
    --seed 7192280 | tee ./local_log.log
```

The generated .mp4 is then stored under inference directory

[./inference/A_person_is_riding_a_bicycle_past_the_Eiffel_Tower.mp4](./inference/A_person_is_riding_a_bicycle_past_the_Eiffel_Tower.mp4)