Figure 1: We modify the lip motion of an actor in a target video (a) so that it aligns with a new audio track. Our set-up consists of a single video camera that films a dubber in a recording studio (b + c). Our system transfers the mouth motion of the voice actor (d) to the target actor and creates a new plausible video of the target actor speaking in the dubbed language (e). Abstract In many countries, foreign movies and TV productions are dubbed, i.e., the original voice of an actor is replaced with a translation that is spoken by a dubbing actor in the country
Visual video dubbing approaches try to match the mouth motion to a dubbed audio-track REF .
VDub: Modifying Face Video of Actors for Plausible Visual Alignment to a Dubbed Audio Track
Comput. Graph. Forum
Comput. Graph. Forum
Computer Science