Hugging Face's logo

alibaba-pai
/
CogVideoX-Fun-V1.1-5b-Pose

Diffusers
Safetensors
CogVideoXPipeline
Model card Files Community
bubbliiiing commited on
Commit
7faa413
•
1 Parent(s): 1de9d53

Update Readme

Browse files
Files changed (2) hide show
  1. README.md +72 -20
  2. README_en.md +75 -20
README.md CHANGED
@@ -35,7 +35,7 @@ tasks:
35
 
36
  [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-yellow)](https://huggingface.co/spaces/alibaba-pai/CogVideoX-Fun-5b)
37
 
38
- [English](./README.md) | 简体中文
39
 
40
  # 目录
41
  - [目录](#目录)
@@ -142,42 +142,43 @@ Linux 的详细信息：
142
  # 视频作品
143
  所展示的结果都是图生视频获得。
144
 
145
- ### CogVideoX-Fun-5B
146
 
147
  Resolution-1024
148
 
149
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
150
  <tr>
151
  <td>
152
- <video src="https://github.com/user-attachments/assets/ec749326-b529-453f-a4b4-f587875dff64" width="100%" controls autoplay loop></video>
153
  </td>
154
  <td>
155
- <video src="https://github.com/user-attachments/assets/84df4178-f493-4aa8-a888-d2020338da82" width="100%" controls autoplay loop></video>
156
  </td>
157
  <td>
158
- <video src="https://github.com/user-attachments/assets/c66c139d-94d3-4930-985b-60e3e0600d8f" width="100%" controls autoplay loop></video>
159
  </td>
160
  <td>
161
- <video src="https://github.com/user-attachments/assets/647c0e0c-28d6-473e-b4eb-a30197dddefc" width="100%" controls autoplay loop></video>
162
  </td>
163
  </tr>
164
  </table>
165
 
 
166
  Resolution-768
167
 
168
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
169
  <tr>
170
  <td>
171
- <video src="https://github.com/user-attachments/assets/647d45b0-4253-4438-baf3-f692789bde78" width="100%" controls autoplay loop></video>
172
  </td>
173
  <td>
174
- <video src="https://github.com/user-attachments/assets/e5a5a948-5c34-445d-9446-324a666a6a33" width="100%" controls autoplay loop></video>
175
  </td>
176
  <td>
177
- <video src="https://github.com/user-attachments/assets/0e605797-4a86-4e0c-8589-40ed686d97a4" width="100%" controls autoplay loop></video>
178
  </td>
179
  <td>
180
- <video src="https://github.com/user-attachments/assets/5356bf79-0a3b-4caf-ac31-2d796e20e429" width="100%" controls autoplay loop></video>
181
  </td>
182
  </tr>
183
  </table>
@@ -187,41 +188,92 @@ Resolution-512
187
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
188
  <tr>
189
  <td>
190
- <video src="https://github.com/user-attachments/assets/5a9f3457-fe82-4082-8494-d8f4f8db75e9" width="100%" controls autoplay loop></video>
191
  </td>
192
  <td>
193
- <video src="https://github.com/user-attachments/assets/ca6874b8-41d1-4f02-bee3-4fc886f309ad" width="100%" controls autoplay loop></video>
194
  </td>
195
  <td>
196
- <video src="https://github.com/user-attachments/assets/9216b348-2c80-4eab-9c1c-dd3a54b7ea1e" width="100%" controls autoplay loop></video>
 
 
 
197
  </td>
 
 
 
 
 
 
 
198
  <td>
199
- <video src="https://github.com/user-attachments/assets/e99ec495-655f-44d8-afa7-3ad0a14f9975" width="100%" controls autoplay loop></video>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
200
  </td>
201
  </tr>
202
  </table>
203
 
204
- ### CogVideoX-Fun-2B
205
 
206
  Resolution-768
207
 
208
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
209
  <tr>
210
  <td>
211
- <video src="https://github.com/user-attachments/assets/d329b4d4-f08f-4e77-887e-049cfc93a908" width="100%" controls autoplay loop></video>
212
  </td>
213
  <td>
214
- <video src="https://github.com/user-attachments/assets/dd7fa2d5-9871-436c-ae5a-44f1494c9c9f" width="100%" controls autoplay loop></video>
215
  </td>
216
  <td>
217
- <video src="https://github.com/user-attachments/assets/c24a2fa2-2fe3-4277-aa9f-e812a2cf0a4e" width="100%" controls autoplay loop></video>
218
  </td>
219
  <td>
220
- <video src="https://github.com/user-attachments/assets/573edac3-8bd0-4e95-82df-bcfdcba9a73f" width="100%" controls autoplay loop></video>
221
  </td>
222
  </tr>
223
  </table>
224
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
225
 
226
  # 如何使用
227
 
@@ -350,4 +402,4 @@ V1.0:
350
 
351
  CogVideoX-2B 模型 (包括其对应的Transformers模块，VAE模块) 根据 [Apache 2.0 协议](LICENSE) 许可证发布。
352
 
353
- CogVideoX-5B 模型（Transformer 模块）在[CogVideoX许可证](https://huggingface.co/THUDM/CogVideoX-5b/blob/main/LICENSE)下发布.
 
35
 
36
  [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-yellow)](https://huggingface.co/spaces/alibaba-pai/CogVideoX-Fun-5b)
37
 
38
+ [English](./README_en.md) | 简体中文
39
 
40
  # 目录
41
  - [目录](#目录)
 
142
  # 视频作品
143
  所展示的结果都是图生视频获得。
144
 
145
+ ### CogVideoX-Fun-V1.1-5B
146
 
147
  Resolution-1024
148
 
149
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
150
  <tr>
151
  <td>
152
+ <video src="https://github.com/user-attachments/assets/34e7ec8f-293e-4655-bb14-5e1ee476f788" width="100%" controls autoplay loop></video>
153
  </td>
154
  <td>
155
+ <video src="https://github.com/user-attachments/assets/7809c64f-eb8c-48a9-8bdc-ca9261fd5434" width="100%" controls autoplay loop></video>
156
  </td>
157
  <td>
158
+ <video src="https://github.com/user-attachments/assets/8e76aaa4-c602-44ac-bcb4-8b24b72c386c" width="100%" controls autoplay loop></video>
159
  </td>
160
  <td>
161
+ <video src="https://github.com/user-attachments/assets/19dba894-7c35-4f25-b15c-384167ab3b03" width="100%" controls autoplay loop></video>
162
  </td>
163
  </tr>
164
  </table>
165
 
166
+
167
  Resolution-768
168
 
169
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
170
  <tr>
171
  <td>
172
+ <video src="https://github.com/user-attachments/assets/0bc339b9-455b-44fd-8917-80272d702737" width="100%" controls autoplay loop></video>
173
  </td>
174
  <td>
175
+ <video src="https://github.com/user-attachments/assets/70a043b9-6721-4bd9-be47-78b7ec5c27e9" width="100%" controls autoplay loop></video>
176
  </td>
177
  <td>
178
+ <video src="https://github.com/user-attachments/assets/d5dd6c09-14f3-40f8-8b6d-91e26519b8ac" width="100%" controls autoplay loop></video>
179
  </td>
180
  <td>
181
+ <video src="https://github.com/user-attachments/assets/9327e8bc-4f17-46b0-b50d-38c250a9483a" width="100%" controls autoplay loop></video>
182
  </td>
183
  </tr>
184
  </table>
 
188
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
189
  <tr>
190
  <td>
191
+ <video src="https://github.com/user-attachments/assets/ef407030-8062-454d-aba3-131c21e6b58c" width="100%" controls autoplay loop></video>
192
  </td>
193
  <td>
194
+ <video src="https://github.com/user-attachments/assets/7610f49e-38b6-4214-aa48-723ae4d1b07e" width="100%" controls autoplay loop></video>
195
  </td>
196
  <td>
197
+ <video src="https://github.com/user-attachments/assets/1fff0567-1e15-415c-941e-53ee8ae2c841" width="100%" controls autoplay loop></video>
198
+ </td>
199
+ <td>
200
+ <video src="https://github.com/user-attachments/assets/bcec48da-b91b-43a0-9d50-cf026e00fa4f" width="100%" controls autoplay loop></video>
201
  </td>
202
+ </tr>
203
+ </table>
204
+
205
+ ### CogVideoX-Fun-V1.1-5B-Pose
206
+
207
+ <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
208
+ <tr>
209
  <td>
210
+ Resolution-512
211
+ </td>
212
+ <td>
213
+ Resolution-768
214
+ </td>
215
+ <td>
216
+ Resolution-1024
217
+ </td>
218
+ <tr>
219
+ <td>
220
+ <video src="https://github.com/user-attachments/assets/a746df51-9eb7-4446-bee5-2ee30285c143" width="100%" controls autoplay loop></video>
221
+ </td>
222
+ <td>
223
+ <video src="https://github.com/user-attachments/assets/db295245-e6aa-43be-8c81-32cb411f1473" width="100%" controls autoplay loop></video>
224
+ </td>
225
+ <td>
226
+ <video src="https://github.com/user-attachments/assets/ec9875b2-fde0-48e1-ab7e-490cee51ef40" width="100%" controls autoplay loop></video>
227
  </td>
228
  </tr>
229
  </table>
230
 
231
+ ### CogVideoX-Fun-V1.1-2B
232
 
233
  Resolution-768
234
 
235
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
236
  <tr>
237
  <td>
238
+ <video src="https://github.com/user-attachments/assets/03235dea-980e-4fc5-9c41-e40a5bc1b6d0" width="100%" controls autoplay loop></video>
239
  </td>
240
  <td>
241
+ <video src="https://github.com/user-attachments/assets/f7302648-5017-47db-bdeb-4d893e620b37" width="100%" controls autoplay loop></video>
242
  </td>
243
  <td>
244
+ <video src="https://github.com/user-attachments/assets/cbadf411-28fa-4b87-813d-da63ff481904" width="100%" controls autoplay loop></video>
245
  </td>
246
  <td>
247
+ <video src="https://github.com/user-attachments/assets/87cc9d0b-b6fe-4d2d-b447-174513d169ab" width="100%" controls autoplay loop></video>
248
  </td>
249
  </tr>
250
  </table>
251
 
252
+ ### CogVideoX-Fun-V1.1-2B-Pose
253
+
254
+ <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
255
+ <tr>
256
+ <td>
257
+ Resolution-512
258
+ </td>
259
+ <td>
260
+ Resolution-768
261
+ </td>
262
+ <td>
263
+ Resolution-1024
264
+ </td>
265
+ <tr>
266
+ <td>
267
+ <video src="https://github.com/user-attachments/assets/487bcd7b-1b7f-4bb4-95b5-96a6b6548b3e" width="100%" controls autoplay loop></video>
268
+ </td>
269
+ <td>
270
+ <video src="https://github.com/user-attachments/assets/2710fd18-8489-46e4-8086-c237309ae7f6" width="100%" controls autoplay loop></video>
271
+ </td>
272
+ <td>
273
+ <video src="https://github.com/user-attachments/assets/b79513db-7747-4512-b86c-94f9ca447fe2" width="100%" controls autoplay loop></video>
274
+ </td>
275
+ </tr>
276
+ </table>
277
 
278
  # 如何使用
279
 
 
402
 
403
  CogVideoX-2B 模型 (包括其对应的Transformers模块，VAE模块) 根据 [Apache 2.0 协议](LICENSE) 许可证发布。
404
 
405
+ CogVideoX-5B 模型（Transformer 模块）在[CogVideoX许可证](https://huggingface.co/THUDM/CogVideoX-5b/blob/main/LICENSE)下发布.
README_en.md CHANGED
@@ -4,7 +4,7 @@
4
 
5
  [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-yellow)](https://huggingface.co/spaces/alibaba-pai/CogVideoX-Fun-5b)
6
 
7
- English | [简体中文](./README_zh-CN.md)
8
 
9
  # Table of Contents
10
  - [Table of Contents](#table-of-contents)
@@ -113,42 +113,43 @@ We'd better place the [weights](#model-zoo) along the specified path:
113
  # Video Result
114
  The results displayed are all based on image.
115
 
116
- ### CogVideoX-Fun-5B
117
 
118
  Resolution-1024
119
 
120
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
121
  <tr>
122
  <td>
123
- <video src="https://github.com/user-attachments/assets/ec749326-b529-453f-a4b4-f587875dff64" width="100%" controls autoplay loop></video>
124
  </td>
125
  <td>
126
- <video src="https://github.com/user-attachments/assets/84df4178-f493-4aa8-a888-d2020338da82" width="100%" controls autoplay loop></video>
127
  </td>
128
  <td>
129
- <video src="https://github.com/user-attachments/assets/c66c139d-94d3-4930-985b-60e3e0600d8f" width="100%" controls autoplay loop></video>
130
  </td>
131
  <td>
132
- <video src="https://github.com/user-attachments/assets/647c0e0c-28d6-473e-b4eb-a30197dddefc" width="100%" controls autoplay loop></video>
133
  </td>
134
  </tr>
135
  </table>
136
 
 
137
  Resolution-768
138
 
139
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
140
  <tr>
141
  <td>
142
- <video src="https://github.com/user-attachments/assets/647d45b0-4253-4438-baf3-f692789bde78" width="100%" controls autoplay loop></video>
143
  </td>
144
  <td>
145
- <video src="https://github.com/user-attachments/assets/e5a5a948-5c34-445d-9446-324a666a6a33" width="100%" controls autoplay loop></video>
146
  </td>
147
  <td>
148
- <video src="https://github.com/user-attachments/assets/0e605797-4a86-4e0c-8589-40ed686d97a4" width="100%" controls autoplay loop></video>
149
  </td>
150
  <td>
151
- <video src="https://github.com/user-attachments/assets/5356bf79-0a3b-4caf-ac31-2d796e20e429" width="100%" controls autoplay loop></video>
152
  </td>
153
  </tr>
154
  </table>
@@ -158,35 +159,89 @@ Resolution-512
158
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
159
  <tr>
160
  <td>
161
- <video src="https://github.com/user-attachments/assets/5a9f3457-fe82-4082-8494-d8f4f8db75e9" width="100%" controls autoplay loop></video>
162
  </td>
163
  <td>
164
- <video src="https://github.com/user-attachments/assets/ca6874b8-41d1-4f02-bee3-4fc886f309ad" width="100%" controls autoplay loop></video>
165
  </td>
166
  <td>
167
- <video src="https://github.com/user-attachments/assets/9216b348-2c80-4eab-9c1c-dd3a54b7ea1e" width="100%" controls autoplay loop></video>
168
  </td>
169
  <td>
170
- <video src="https://github.com/user-attachments/assets/e99ec495-655f-44d8-afa7-3ad0a14f9975" width="100%" controls autoplay loop></video>
171
  </td>
172
  </tr>
173
  </table>
174
 
175
- ### CogVideoX-Fun-2B
176
 
177
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
178
  <tr>
179
  <td>
180
- <video src="https://github.com/user-attachments/assets/d329b4d4-f08f-4e77-887e-049cfc93a908" width="100%" controls autoplay loop></video>
181
  </td>
182
  <td>
183
- <video src="https://github.com/user-attachments/assets/dd7fa2d5-9871-436c-ae5a-44f1494c9c9f" width="100%" controls autoplay loop></video>
184
  </td>
185
  <td>
186
- <video src="https://github.com/user-attachments/assets/c24a2fa2-2fe3-4277-aa9f-e812a2cf0a4e" width="100%" controls autoplay loop></video>
 
 
 
 
 
 
 
 
 
 
187
  </td>
 
 
 
 
 
 
 
 
 
188
  <td>
189
- <video src="https://github.com/user-attachments/assets/573edac3-8bd0-4e95-82df-bcfdcba9a73f" width="100%" controls autoplay loop></video>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
190
  </td>
191
  </tr>
192
  </table>
@@ -284,7 +339,7 @@ Then, we run scripts/train.sh.
284
  sh scripts/train.sh
285
  ```
286
 
287
- For details on setting some parameters, please refer to [Readme Train](scripts/README_TRAIN.md) and [Readme Lora](scripts/README_TRAIN_LORA.md).
288
 
289
 
290
  # Model zoo
 
4
 
5
  [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-yellow)](https://huggingface.co/spaces/alibaba-pai/CogVideoX-Fun-5b)
6
 
7
+ English | [简体中文](./README.md)
8
 
9
  # Table of Contents
10
  - [Table of Contents](#table-of-contents)
 
113
  # Video Result
114
  The results displayed are all based on image.
115
 
116
+ ### CogVideoX-Fun-V1.1-5B
117
 
118
  Resolution-1024
119
 
120
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
121
  <tr>
122
  <td>
123
+ <video src="https://github.com/user-attachments/assets/34e7ec8f-293e-4655-bb14-5e1ee476f788" width="100%" controls autoplay loop></video>
124
  </td>
125
  <td>
126
+ <video src="https://github.com/user-attachments/assets/7809c64f-eb8c-48a9-8bdc-ca9261fd5434" width="100%" controls autoplay loop></video>
127
  </td>
128
  <td>
129
+ <video src="https://github.com/user-attachments/assets/8e76aaa4-c602-44ac-bcb4-8b24b72c386c" width="100%" controls autoplay loop></video>
130
  </td>
131
  <td>
132
+ <video src="https://github.com/user-attachments/assets/19dba894-7c35-4f25-b15c-384167ab3b03" width="100%" controls autoplay loop></video>
133
  </td>
134
  </tr>
135
  </table>
136
 
137
+
138
  Resolution-768
139
 
140
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
141
  <tr>
142
  <td>
143
+ <video src="https://github.com/user-attachments/assets/0bc339b9-455b-44fd-8917-80272d702737" width="100%" controls autoplay loop></video>
144
  </td>
145
  <td>
146
+ <video src="https://github.com/user-attachments/assets/70a043b9-6721-4bd9-be47-78b7ec5c27e9" width="100%" controls autoplay loop></video>
147
  </td>
148
  <td>
149
+ <video src="https://github.com/user-attachments/assets/d5dd6c09-14f3-40f8-8b6d-91e26519b8ac" width="100%" controls autoplay loop></video>
150
  </td>
151
  <td>
152
+ <video src="https://github.com/user-attachments/assets/9327e8bc-4f17-46b0-b50d-38c250a9483a" width="100%" controls autoplay loop></video>
153
  </td>
154
  </tr>
155
  </table>
 
159
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
160
  <tr>
161
  <td>
162
+ <video src="https://github.com/user-attachments/assets/ef407030-8062-454d-aba3-131c21e6b58c" width="100%" controls autoplay loop></video>
163
  </td>
164
  <td>
165
+ <video src="https://github.com/user-attachments/assets/7610f49e-38b6-4214-aa48-723ae4d1b07e" width="100%" controls autoplay loop></video>
166
  </td>
167
  <td>
168
+ <video src="https://github.com/user-attachments/assets/1fff0567-1e15-415c-941e-53ee8ae2c841" width="100%" controls autoplay loop></video>
169
  </td>
170
  <td>
171
+ <video src="https://github.com/user-attachments/assets/bcec48da-b91b-43a0-9d50-cf026e00fa4f" width="100%" controls autoplay loop></video>
172
  </td>
173
  </tr>
174
  </table>
175
 
176
+ ### CogVideoX-Fun-V1.1-5B-Pose
177
 
178
  <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
179
  <tr>
180
  <td>
181
+ Resolution-512
182
  </td>
183
  <td>
184
+ Resolution-768
185
  </td>
186
  <td>
187
+ Resolution-1024
188
+ </td>
189
+ <tr>
190
+ <td>
191
+ <video src="https://github.com/user-attachments/assets/a746df51-9eb7-4446-bee5-2ee30285c143" width="100%" controls autoplay loop></video>
192
+ </td>
193
+ <td>
194
+ <video src="https://github.com/user-attachments/assets/db295245-e6aa-43be-8c81-32cb411f1473" width="100%" controls autoplay loop></video>
195
+ </td>
196
+ <td>
197
+ <video src="https://github.com/user-attachments/assets/ec9875b2-fde0-48e1-ab7e-490cee51ef40" width="100%" controls autoplay loop></video>
198
  </td>
199
+ </tr>
200
+ </table>
201
+
202
+ ### CogVideoX-Fun-V1.1-2B
203
+
204
+ Resolution-768
205
+
206
+ <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
207
+ <tr>
208
  <td>
209
+ <video src="https://github.com/user-attachments/assets/03235dea-980e-4fc5-9c41-e40a5bc1b6d0" width="100%" controls autoplay loop></video>
210
+ </td>
211
+ <td>
212
+ <video src="https://github.com/user-attachments/assets/f7302648-5017-47db-bdeb-4d893e620b37" width="100%" controls autoplay loop></video>
213
+ </td>
214
+ <td>
215
+ <video src="https://github.com/user-attachments/assets/cbadf411-28fa-4b87-813d-da63ff481904" width="100%" controls autoplay loop></video>
216
+ </td>
217
+ <td>
218
+ <video src="https://github.com/user-attachments/assets/87cc9d0b-b6fe-4d2d-b447-174513d169ab" width="100%" controls autoplay loop></video>
219
+ </td>
220
+ </tr>
221
+ </table>
222
+
223
+ ### CogVideoX-Fun-V1.1-2B-Pose
224
+
225
+ <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
226
+ <tr>
227
+ <td>
228
+ Resolution-512
229
+ </td>
230
+ <td>
231
+ Resolution-768
232
+ </td>
233
+ <td>
234
+ Resolution-1024
235
+ </td>
236
+ <tr>
237
+ <td>
238
+ <video src="https://github.com/user-attachments/assets/487bcd7b-1b7f-4bb4-95b5-96a6b6548b3e" width="100%" controls autoplay loop></video>
239
+ </td>
240
+ <td>
241
+ <video src="https://github.com/user-attachments/assets/2710fd18-8489-46e4-8086-c237309ae7f6" width="100%" controls autoplay loop></video>
242
+ </td>
243
+ <td>
244
+ <video src="https://github.com/user-attachments/assets/b79513db-7747-4512-b86c-94f9ca447fe2" width="100%" controls autoplay loop></video>
245
  </td>
246
  </tr>
247
  </table>
 
339
  sh scripts/train.sh
340
  ```
341
 
342
+ For details on setting some parameters, please refer to [Readme Train](scripts/README_TRAIN.md), [Readme Lora](scripts/README_TRAIN_LORA.md) and [Readme Control](scripts/README_TRAIN_CONTROL.md).
343
 
344
 
345
  # Model zoo