Update README.md
Browse files
README.md
CHANGED
@@ -7,21 +7,21 @@ tags:
|
|
7 |
---
|
8 |
This CogVideoX LoRA is created as part of a <b>fan project</b> for <b>research purposes</b> only and is <b>not</b> intended for commercial use. It is based on the TV series called Arcane which are protected by copyright. Users utilize the model at their own risk. Users are obligated to comply with copyright laws and applicable regulations. The model has been developed for non-commercial purposes, and it is not my intention to infringe on any copyright. I assume no responsibility for any damages or legal consequences arising from the use of the model.
|
9 |
|
10 |
-
|
11 |
|
12 |
- Despite the LoRA started to learn the appearance of the main characters it still doesn't able to reproduce them accurately. So don't expect to see your beloved characters.
|
13 |
- For the best quality do not use quantization (like fp8) or sage attention
|
14 |
|
15 |
-
|
16 |
- CogVideoX 1.0 (It does not work with CogVideox 1.5 models)
|
17 |
|
18 |
-
|
19 |
|
20 |
Use these in your prompt helps providing the style. See example prompt below.
|
21 |
- csetiarcane
|
22 |
|
23 |
|
24 |
-
<u><b>Inference:</u></b>
|
25 |
|
26 |
You can use the finetuned model for inference with the following code:
|
27 |
|
@@ -41,14 +41,15 @@ video = pipe("walgro1. The scene begins with a close-up of Gromit’s face, his
|
|
41 |
export_to_video(video, "output.mp4", fps=8)
|
42 |
|
43 |
```
|
44 |
-
|
|
|
45 |
|
46 |
- Thanks to the [CogVideo team](https://github.com/a-r-r-o-w/cogvideox-factory) for making these great models available
|
47 |
- Thanks to [A-R-R-O-W](https://github.com/a-r-r-o-w) for his [CogVideoX-Factory](https://github.com/a-r-r-o-w/cogvideox-factory) that helps us making CogVideo LoRAs more easier.
|
48 |
- Thanks to [Kijai](https://github.com/kijai) for his great [ComfyUI integration](https://github.com/kijai/ComfyUI-CogVideoXWrapper)
|
49 |
- Thanks to [POM](https://huggingface.co/peteromallet) for providing the computing resources. Without this, these LoRAs could not have been created.
|
50 |
|
51 |
-
|
52 |
|
53 |
<b>Prompt:</b> "walgro1. Gromit sits quietly in a cozy living room, the soft glow of a nearby lamp casting warm light across the room. The camera starts with a close-up of his thoughtful expression, his eyes darting toward the side, observing the subtle movement of something off-screen. A clock ticks rhythmically on the wall behind him, creating a steady backdrop to the otherwise silent room.
|
54 |
The camera slowly pulls back to reveal the setting: a tidy space with bookshelves filled with old volumes, a comfortable armchair in the corner, and a small coffee table in the center, where a half-finished jigsaw puzzle lies scattered. The atmosphere is calm, almost serene, as Gromit glances toward the puzzle, his curiosity piqued."
|
@@ -57,7 +58,8 @@ The camera slowly pulls back to reveal the setting: a tidy space with bookshelve
|
|
57 |
Your browser does not support the video tag.
|
58 |
</video>
|
59 |
|
60 |
-
|
|
|
61 |
@article{yang2024cogvideox,
|
62 |
title={CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer},
|
63 |
author={Yang, Zhuoyi and Teng, Jiayan and Zheng, Wendi and Ding, Ming and Huang, Shiyu and Xu, Jiazheng and Yang, Yuanming and Hong, Wenyi and Zhang, Xiaohan and Feng, Guanyu and others},
|
@@ -69,4 +71,5 @@ The camera slowly pulls back to reveal the setting: a tidy space with bookshelve
|
|
69 |
author={Hong, Wenyi and Ding, Ming and Zheng, Wendi and Liu, Xinghan and Tang, Jie},
|
70 |
journal={arXiv preprint arXiv:2205.15868},
|
71 |
year={2022}
|
72 |
-
}
|
|
|
|
7 |
---
|
8 |
This CogVideoX LoRA is created as part of a <b>fan project</b> for <b>research purposes</b> only and is <b>not</b> intended for commercial use. It is based on the TV series called Arcane which are protected by copyright. Users utilize the model at their own risk. Users are obligated to comply with copyright laws and applicable regulations. The model has been developed for non-commercial purposes, and it is not my intention to infringe on any copyright. I assume no responsibility for any damages or legal consequences arising from the use of the model.
|
9 |
|
10 |
+
## Important Notes:
|
11 |
|
12 |
- Despite the LoRA started to learn the appearance of the main characters it still doesn't able to reproduce them accurately. So don't expect to see your beloved characters.
|
13 |
- For the best quality do not use quantization (like fp8) or sage attention
|
14 |
|
15 |
+
## Compatibility:
|
16 |
- CogVideoX 1.0 (It does not work with CogVideox 1.5 models)
|
17 |
|
18 |
+
## ID Token / Trigger word(s):
|
19 |
|
20 |
Use these in your prompt helps providing the style. See example prompt below.
|
21 |
- csetiarcane
|
22 |
|
23 |
|
24 |
+
## <u><b>Inference:</u></b>
|
25 |
|
26 |
You can use the finetuned model for inference with the following code:
|
27 |
|
|
|
41 |
export_to_video(video, "output.mp4", fps=8)
|
42 |
|
43 |
```
|
44 |
+
|
45 |
+
## Acknowledgment:
|
46 |
|
47 |
- Thanks to the [CogVideo team](https://github.com/a-r-r-o-w/cogvideox-factory) for making these great models available
|
48 |
- Thanks to [A-R-R-O-W](https://github.com/a-r-r-o-w) for his [CogVideoX-Factory](https://github.com/a-r-r-o-w/cogvideox-factory) that helps us making CogVideo LoRAs more easier.
|
49 |
- Thanks to [Kijai](https://github.com/kijai) for his great [ComfyUI integration](https://github.com/kijai/ComfyUI-CogVideoXWrapper)
|
50 |
- Thanks to [POM](https://huggingface.co/peteromallet) for providing the computing resources. Without this, these LoRAs could not have been created.
|
51 |
|
52 |
+
## Examples:
|
53 |
|
54 |
<b>Prompt:</b> "walgro1. Gromit sits quietly in a cozy living room, the soft glow of a nearby lamp casting warm light across the room. The camera starts with a close-up of his thoughtful expression, his eyes darting toward the side, observing the subtle movement of something off-screen. A clock ticks rhythmically on the wall behind him, creating a steady backdrop to the otherwise silent room.
|
55 |
The camera slowly pulls back to reveal the setting: a tidy space with bookshelves filled with old volumes, a comfortable armchair in the corner, and a small coffee table in the center, where a half-finished jigsaw puzzle lies scattered. The atmosphere is calm, almost serene, as Gromit glances toward the puzzle, his curiosity piqued."
|
|
|
58 |
Your browser does not support the video tag.
|
59 |
</video>
|
60 |
|
61 |
+
## Citation
|
62 |
+
```
|
63 |
@article{yang2024cogvideox,
|
64 |
title={CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer},
|
65 |
author={Yang, Zhuoyi and Teng, Jiayan and Zheng, Wendi and Ding, Ming and Huang, Shiyu and Xu, Jiazheng and Yang, Yuanming and Hong, Wenyi and Zhang, Xiaohan and Feng, Guanyu and others},
|
|
|
71 |
author={Hong, Wenyi and Ding, Ming and Zheng, Wendi and Liu, Xinghan and Tang, Jie},
|
72 |
journal={arXiv preprint arXiv:2205.15868},
|
73 |
year={2022}
|
74 |
+
}
|
75 |
+
```
|