Patent ID: 7697787

Claim:
A method for dynamically replacing in real time the face of an actor in a video clip, with the one of a user of an entertainment video system, comprising the steps of: in a preparation phase: taking at least one first fixed picture of the face of the user; building a 3D-model of that face; replacing a first video picture of the face of the actor with a reproduction of the face of the user after matching their respective size and orientation; and while the clip is going on: taking periodically a current picture of the face of the user; calculating current transformation vectors of the face of the user from a preceding picture of the face of the user to the current picture of the face of the user, using the 3D-model to determine said transformations; and dynamically replacing the face of the actor in successive pictures of the video clip every 20 milliseconds with successive pictures reproducing the face of the user by applying at least orientation, size and displacement vectors to the 3D-model of the face of the user on the basis of orientation, size and displacement vectors calculated for the face of the actor in the clip and applying to a preceding picture of the user inserted in the clip the current transformation vectors of the face of the user, such that expressions in the face of the user and transitions of the face of the actor in the successive pictures of the video clip are followed.