LivePortrait plus sound

#16
by ArturasLT - opened

Hello, dear community,

We found that Liveportrait project is quite perspective it will have many practical usages.

We work in the museum sector and create audio-visual experiences for visitors.
We tried this solution to animate the historical photo and the results were greater than we expected.

I'm wondering if it is possible to add a voice-over in the video using this tool?

This feature would be very useful in completing a full animation.

Here is our video example:

Kuaishou Visual Generation and Interaction Center org

Thanks for you feedback. @ArturasLT

We will check the env of HF space, if ffmpeg and ffprobe installed, we will add this feature.

Or, you can run it locally using https://github.com/KwaiVGI/LivePortrait : )

Kuaishou Visual Generation and Interaction Center org

We added the sound @ArturasLT

nice ida

can i offer ida?

You can also upload a video, and it will be able to recognize faces even when they are moving.
You can choose which face you want to talk.
You can make the tongue move in the mouth according to the logic of AI and languages.
You can make it recognize multiple people, for example, 2 people talking, and then choose who is speaking and which character each one represents.

Hey, many thanks for adding the sound @cleardusk !!!
I will update you once the project is finished and share the results.

Kuaishou Visual Generation and Interaction Center org

@ArturasLT For more fetures, keep watching our GitHub repo: https://github.com/KwaiVGI/LivePortrait : )

when i run the inferance.py file audio is lost . who can i fix this @cleardusk

Sign up or log in to comment