End of training
Browse files- README.md +75 -0
- checkpoint-1000/optimizer.bin +3 -0
- checkpoint-1000/pytorch_lora_weights.safetensors +3 -0
- checkpoint-1000/random_states_0.pkl +3 -0
- checkpoint-1000/scaler.pt +3 -0
- checkpoint-1000/scheduler.bin +3 -0
- checkpoint-2000/optimizer.bin +3 -0
- checkpoint-2000/pytorch_lora_weights.safetensors +3 -0
- checkpoint-2000/random_states_0.pkl +3 -0
- checkpoint-2000/scaler.pt +3 -0
- checkpoint-2000/scheduler.bin +3 -0
- pytorch_lora_weights.safetensors +3 -0
- test_video_0_zlkwdnk_liquid_art_of_A_v.mp4 +0 -0
- test_video_0_zlkwdnk_liquid_art_of_a_c.mp4 +0 -0
- validation_video_0_zlkwdnk_liquid_art_of_A_v.mp4 +0 -0
- validation_video_0_zlkwdnk_liquid_art_of_a_c.mp4 +0 -0
README.md
ADDED
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model: THUDM/CogVideoX-2b
|
3 |
+
library_name: diffusers
|
4 |
+
license: other
|
5 |
+
tags:
|
6 |
+
- text-to-video
|
7 |
+
- diffusers-training
|
8 |
+
- diffusers
|
9 |
+
- lora
|
10 |
+
- cogvideox
|
11 |
+
- cogvideox-diffusers
|
12 |
+
- template:sd-lora
|
13 |
+
widget: []
|
14 |
+
---
|
15 |
+
|
16 |
+
<!-- This model card has been generated automatically according to the information the training script had access to. You
|
17 |
+
should probably proofread and complete it, then remove this comment. -->
|
18 |
+
|
19 |
+
|
20 |
+
# CogVideoX LoRA - Zlikwid/ZlikwidCogVideoXLoRa
|
21 |
+
|
22 |
+
<Gallery />
|
23 |
+
|
24 |
+
## Model description
|
25 |
+
|
26 |
+
These are Zlikwid/ZlikwidCogVideoXLoRa LoRA weights for THUDM/CogVideoX-2b.
|
27 |
+
|
28 |
+
The weights were trained using the [CogVideoX Diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/cogvideo/train_cogvideox_lora.py).
|
29 |
+
|
30 |
+
Was LoRA for the text encoder enabled? No.
|
31 |
+
|
32 |
+
## Download model
|
33 |
+
|
34 |
+
[Download the *.safetensors LoRA](Zlikwid/ZlikwidCogVideoXLoRa/tree/main) in the Files & versions tab.
|
35 |
+
|
36 |
+
## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
|
37 |
+
|
38 |
+
```py
|
39 |
+
from diffusers import CogVideoXPipeline
|
40 |
+
import torch
|
41 |
+
|
42 |
+
pipe = CogVideoXPipeline.from_pretrained("THUDM/CogVideoX-5b", torch_dtype=torch.bfloat16).to("cuda")
|
43 |
+
pipe.load_lora_weights("Zlikwid/ZlikwidCogVideoXLoRa", weight_name="pytorch_lora_weights.safetensors", adapter_name=["cogvideox-lora"])
|
44 |
+
|
45 |
+
# The LoRA adapter weights are determined by what was used for training.
|
46 |
+
# In this case, we assume `--lora_alpha` is 32 and `--rank` is 64.
|
47 |
+
# It can be made lower or higher from what was used in training to decrease or amplify the effect
|
48 |
+
# of the LoRA upto a tolerance, beyond which one might notice no effect at all or overflows.
|
49 |
+
pipe.set_adapters(["cogvideox-lora"], [32 / 64])
|
50 |
+
|
51 |
+
video = pipe("None", guidance_scale=6, use_dynamic_cfg=True).frames[0]
|
52 |
+
```
|
53 |
+
|
54 |
+
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
|
55 |
+
|
56 |
+
## License
|
57 |
+
|
58 |
+
Please adhere to the licensing terms as described [here](https://huggingface.co/THUDM/CogVideoX-5b/blob/main/LICENSE) and [here](https://huggingface.co/THUDM/CogVideoX-2b/blob/main/LICENSE).
|
59 |
+
|
60 |
+
|
61 |
+
## Intended uses & limitations
|
62 |
+
|
63 |
+
#### How to use
|
64 |
+
|
65 |
+
```python
|
66 |
+
# TODO: add an example code snippet for running this diffusion pipeline
|
67 |
+
```
|
68 |
+
|
69 |
+
#### Limitations and bias
|
70 |
+
|
71 |
+
[TODO: provide examples of latent issues and potential remediations]
|
72 |
+
|
73 |
+
## Training details
|
74 |
+
|
75 |
+
[TODO: describe the data used to train the model]
|
checkpoint-1000/optimizer.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3fe97c47fe955f6b352371ef23c2780735b244d29a48ee36f00c9a459bff0c09
|
3 |
+
size 60186810
|
checkpoint-1000/pytorch_lora_weights.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7c80c5cc6135f480dba007196cd8c877a912339196c99168cdd344c31d801b2b
|
3 |
+
size 117996224
|
checkpoint-1000/random_states_0.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2fffe0ac9d80271d0c3a62f28a7b2ef71e05f3c2d042d41c6fbebde848bd5d93
|
3 |
+
size 14604
|
checkpoint-1000/scaler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9d8fdcd0311eba9854fff738038ed4c1a269832665b4d88ba4e4e3d02a1a7e0e
|
3 |
+
size 988
|
checkpoint-1000/scheduler.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e28cc7d09de3334ca2ec47037c0d83a6e236487735944c263910f5ac3f538447
|
3 |
+
size 1000
|
checkpoint-2000/optimizer.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b08d3c7e4e829336a802852cb45a469d017b2b3058e75e78a45dd27d4ff3892c
|
3 |
+
size 60186810
|
checkpoint-2000/pytorch_lora_weights.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b112a9a983a2d6508f2d2df01abd491e612ccb54ce4d847607e8f7ac512f65c4
|
3 |
+
size 117996224
|
checkpoint-2000/random_states_0.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bbc8cac79c7c5d01257e51b41b8b6f8aacb8f0323849756532005ac052ce63c0
|
3 |
+
size 14604
|
checkpoint-2000/scaler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3c50a9cebe5d66d453d25b140738bff479749ac03e0a43597d8776bc22f6ed0c
|
3 |
+
size 988
|
checkpoint-2000/scheduler.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:db91deb01f551b2babf95ab15f5e7133a5b5c9433697afb0d19c24ab40042d5e
|
3 |
+
size 1000
|
pytorch_lora_weights.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:18d333c06cb38574c0dfe09284969040c8b3a75412bd25ebf359ec7d032d63f3
|
3 |
+
size 59013712
|
test_video_0_zlkwdnk_liquid_art_of_A_v.mp4
ADDED
Binary file (425 kB). View file
|
|
test_video_0_zlkwdnk_liquid_art_of_a_c.mp4
ADDED
Binary file (555 kB). View file
|
|
validation_video_0_zlkwdnk_liquid_art_of_A_v.mp4
ADDED
Binary file (504 kB). View file
|
|
validation_video_0_zlkwdnk_liquid_art_of_a_c.mp4
ADDED
Binary file (621 kB). View file
|
|