Patent ID: 11969543
Assignee: PRESENT COMMUNICATIONS, INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H  A  G  F | IPC A  H

Claim 0:
1. A method comprising:
during a setup period:
accessing a target image of a first user;
accessing a target facial expression container;
representing a target constellation of facial landmarks, detected in the target image, in a target facial landmark container;
generating a target set of face model coefficients;
transforming the target facial landmark container, the target facial expression container, and the target set of face model coefficients into a target synthetic face image according to a synthetic face generator;
adjusting the target set of face model coefficients to reduce differences between the target synthetic face image and a target face detected in the target image; and
generating a first face model, associated with the first user, based on the target set of face model coefficients that have been adjusted; and

during an operating period:
accessing a first video feed depicting the first user;
representing a first constellation of facial landmarks, detected in a first frame of the first video feed, in a first facial landmark container;
representing a first set of action units, based on first facial muscle actions detected in the first frame, in a first facial expression container;
based on a first command to modify facial expressions at a first time according to a target facial expression, modifying the first set of action units in the first frame, according to the target facial expression;
transforming the first facial landmark container, the first facial expression container, and the first face model into a first synthetic face image according to the synthetic face generator; and
rendering the first synthetic face image.