Cseti commited on
Commit
1d69d8f
1 Parent(s): dee8fbe

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +60 -0
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - tencent/HunyuanVideo
4
+ tags:
5
+ - LoRA
6
+ - hunyuan
7
+ ---
8
+
9
+ # Arcane Jinx HunyuanVideo LoRA v1
10
+
11
+ <video width="100%" height="auto" controls>
12
+ <source src="https://huggingface.co/Cseti/CogVideoX1.0-LoRA-Arcane-v1/resolve/main/csetiarcane_comparison_00017.mp4" type="video/mp4">
13
+ </video>
14
+ <b>Prompt:</b> "CSETIARCANE. The video is focusing on girl with blue hair. Her expression transitions subtly across the frames, starting from a somber or contemplative look and progressing to one that appears more engaged or possibly surprised. The lighting is dim and moody, emphasizing shadows and creating a dramatic effect around the character's features. The background remains consistently dark throughout the sequence, ensuring the focus stays solely on the character's changing expressions."
15
+
16
+ ## Important Notes:
17
+
18
+ This LoRA is created as part of a <b>fan project</b> for <b>research purposes</b> only and is <b>not</b> intended for commercial use. It is based on the TV series called Arcane which are protected by copyright. Users utilize the model at their own risk. Users are obligated to comply with copyright laws and applicable regulations. The model has been developed for non-commercial purposes, and it is not my intention to infringe on any copyright. I assume no responsibility for any damages or legal consequences arising from the use of the model.
19
+
20
+ ## Compatibility:
21
+ - HunyuanVideo
22
+
23
+ ## ID Token / Trigger word(s):
24
+
25
+ Use these in your prompt helps providing the character. See example prompt above.
26
+ - csetiarcane, nfjinx, blue hair, black top
27
+
28
+ **Please consider the following:**
29
+
30
+ - If it doesn't produce the character, try increasing the lora strength to 1.2
31
+ - With some seeds it doesn't work well, it simply doesn't produce either the style or the character
32
+ - I definitely recommend using at least the following trigger words in your prompt: **'csetiarcane, nfjinx, blue hair'** .This is probably due to how the dataset was assembled, I'd like to fix this in later versions"
33
+
34
+ ## Acknowledgment:
35
+
36
+ - Thanks to the [Tencent team](https://github.com/Tencent/HunyuanVideo) for making this great model available
37
+ - Thanks to [tdrussel](https://github.com/tdrussell) for the [diffusion-pipe](https://github.com/tdrussell/diffusion-pipe) that helps us making these LoRAs.
38
+ - Thanks to [Kijai](https://github.com/kijai) for his great [ComfyUI integration](https://github.com/kijai/ComfyUI-HunyuanVideoWrapper)
39
+ - Thanks to [POM](https://huggingface.co/peteromallet) for providing the computing resources. Without this, these LoRAs could not have been created.
40
+
41
+ ## Trainig details:
42
+ - LR: 2e-5
43
+ - Optimizer: adamw
44
+ - steps: 6000
45
+ - dataset: 40 (33x704x352) videos
46
+ - rank: 32
47
+ - batch size: 1
48
+ - gradient accumulation steps: 4
49
+
50
+ ## Citation
51
+ ```
52
+ @misc{kong2024hunyuanvideo,
53
+ title={HunyuanVideo: A Systematic Framework For Large Video Generative Models},
54
+ author={Weijie Kong, Qi Tian, Zijian Zhang, Rox Min, Zuozhuo Dai, Jin Zhou, Jiangfeng Xiong, Xin Li, Bo Wu, Jianwei Zhang, Kathrina Wu, Qin Lin, Aladdin Wang, Andong Wang, Changlin Li, Duojun Huang, Fang Yang, Hao Tan, Hongmei Wang, Jacob Song, Jiawang Bai, Jianbing Wu, Jinbao Xue, Joey Wang, Junkun Yuan, Kai Wang, Mengyang Liu, Pengyu Li, Shuai Li, Weiyan Wang, Wenqing Yu, Xinchi Deng, Yang Li, Yanxin Long, Yi Chen, Yutao Cui, Yuanbo Peng, Zhentao Yu, Zhiyu He, Zhiyong Xu, Zixiang Zhou, Zunnan Xu, Yangyu Tao, Qinglin Lu, Songtao Liu, Daquan Zhou, Hongfa Wang, Yong Yang, Di Wang, Yuhong Liu, and Jie Jiang, along with Caesar Zhong},
55
+ year={2024},
56
+ archivePrefix={arXiv preprint arXiv:2412.03603},
57
+ primaryClass={cs.CV},
58
+ url={https://arxiv.org/abs/2412.03603},
59
+ }
60
+ ```