Patent ID: 6778252
Filing Date: 2004-08-17
Classification: G03B,G10L,G11B

Abstract:
A method for modifying an audio visual recording originally produced with an original audio track of an original speaker, using a second audio dub track of a second speaker, to produce a new transformed audio visual recording with synchronized audio to facial expressive speech of the second audio dub track spoken by the original speaker, comprising analyzing the original audio track to convert it into a continuous time coded facial and acoustic symbol stream to identify corresponding visual facial motions of the original speaker to create continuous data sets of facial motion corresponding to speech phoneme utterance states and transformations, storing these continuous data sets in a database, analyzing the second audio dub track to convert it to a continuous time coded facial and acoustic symbol stream, using the second audio dub track's continuous time coded facial and acoustic symbol stream to animate the original speaker's face, synchronized to the second audio dub track to create natural continuous facial speech expression by the original speaker of the second dub audio track.