Patent ID: 11869274
Assignee: GOOGLE LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G

Claim 15:
16. A system comprising:
one or more processors; and
a memory that stores instructions that, when executed by the one or more processors cause the one or more processors to perform operations comprising:
receiving a set of video frames that correspond to a video, the set of video frames including a first video frame and a second video frame that each include a face, wherein the second video frame is subsequent to the first video frame;
performing face tracking on the first video frame to identify a first face resampling keyframe;
performing face tracking on the second video frame to identify a second face resampling keyframe;
deriving an interpolation amount;
interpolating a first background of the first face resampling keyframe and a second background of the second face resampling keyframe based on the interpolation amount;
rendering an interpolated first face and an interpolated second face; and
displaying a final frame that is based on the interpolated first background, the interpolated second background, the interpolated first face, and the interpolated second face.