anchor commited on
Commit
97fc3b6
1 Parent(s): 3a67dcc

update video2video, musetalk case

Browse files
Files changed (1) hide show
  1. README.md +61 -0
README.md CHANGED
@@ -267,7 +267,68 @@ Bellow Case could be found in `configs/tasks/example.yaml`
267
  </table >
268
 
269
  ### VideoMiddle2Video
 
270
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
271
 
272
 
273
  # News
 
267
  </table >
268
 
269
  ### VideoMiddle2Video
270
+ ** pose2video **
271
 
272
+ In duffy case, pose of the vision condition frame is not aligned with of the first frame of control video. `posealign` module can solve it.
273
+
274
+ <table class="center">
275
+ <tr style="font-weight: bolder;text-align:center;">
276
+ <td width="20%">image</td>
277
+ <td width="70%">video</td>
278
+ <td width="10%">prompt</td>
279
+ </tr>
280
+
281
+ <tr>
282
+ <td>
283
+ None, mean generate first frame with extra text2image module
284
+ </td>
285
+ <td>
286
+ <video src="https://cdn-uploads.huggingface.co/production/uploads/65f9352ed760cfdf5eb80e16/-pdPapRbRk_w3YpSyvdGx.mp4" controls preload></video>
287
+ </td>
288
+ <td>
289
+ (masterpiece, best quality, highres:1)
290
+ </td>
291
+ </tr>
292
+
293
+ <tr>
294
+ <td>
295
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/65f9352ed760cfdf5eb80e16/FlLWP8IqM_X2K4hXAOPHO.png" width="200">
296
+ </td>
297
+ <td>
298
+ <video src="https://cdn-uploads.huggingface.co/production/uploads/65f9352ed760cfdf5eb80e16/OT22TR7e7Lcoxci9aoDBA.mp4" controls preload></video>
299
+ </td>
300
+ <td>
301
+ (masterpiece, best quality, highres:1)
302
+ </td>
303
+ </tr>
304
+ </table >
305
+
306
+ ### MuseTalk
307
+
308
+ <table class="center">
309
+ <tr style="font-weight: bolder;text-align:center;">
310
+ <td width="15%">name</td>
311
+ <td width="85%">video</td>
312
+ </tr>
313
+
314
+ <tr>
315
+ <td>
316
+ talk
317
+ </td>
318
+ <td>
319
+ <video src="https://cdn-uploads.huggingface.co/production/uploads/65f9352ed760cfdf5eb80e16/wUhNS7j5UQ28eXu4JVQfF.mp4" controls preload></video>
320
+ </td>
321
+
322
+ <tr>
323
+ <td>
324
+ sing
325
+ </td>
326
+ <td>
327
+ wait
328
+ <!-- <video src="" width="300" controls preload></video> -->
329
+ </td>
330
+ </tr>
331
+ </table >
332
 
333
 
334
  # News