Add pipeline tag, library name and link to paper (#1)
Browse files- Add pipeline tag, library name and link to paper (076ac7b2e5fdaeb8e8415d297fc750ab5be2ba61)
- Update tag (b4255daeaa873b2f276b804bf9ba40632bfc331d)
Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
README.md
CHANGED
@@ -1,8 +1,13 @@
|
|
1 |
-
---
|
2 |
-
license: openrail
|
3 |
-
|
4 |
-
|
5 |
-
|
6 |
-
|
7 |
-
|
8 |
-
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: openrail
|
3 |
+
library_name: diffusers
|
4 |
+
tags:
|
5 |
+
- video-to-video
|
6 |
+
---
|
7 |
+
|
8 |
+
# The checkpoints of LatentSync
|
9 |
+
|
10 |
+
This repo not only stores the pretrained U-Net and SyncNet checkpoints of LatentSync, but also stores the whisper checkpoints, auxiliary checkpoints for detecting face, calculating syncnet confidence score and so on. They have covered all you need for both inference and training of LatentSync
|
11 |
+
|
12 |
+
The model was presented in the paper [LatentSync: Audio Conditioned Latent Diffusion Models for Lip Sync](https://arxiv.org/abs/2412.09262).
|
13 |
+
Code: https://github.com/chunyu-li/LatentSync
|