Patent Document ID: 10147023
Application ID: 15299221
Patent Status: 1

Claim One:
1. A method for markerless face tracking, the method comprising: obtaining a facial rig associated with a subject, wherein the facial rig includes a plurality of expression shapes, wherein an expression shape defines at least a portion of an expression of the subject and includes one or more values for one or more facial attributes; generating a plurality of model states for the facial rig, wherein a model state describes a combination of expression shapes defining an expression of the subject and a set of camera setup location coordinates in relation to the subject; determining a lighting characteristic to use for rendering a computer-generated image of a model state of the plurality of model states; rendering a plurality of computer-generated images of a face of the subject, wherein a computer-generated image is rendered using the lighting characteristic and a corresponding model state of the facial rig; generating a plurality of training samples, wherein a training sample includes a computer generated image and a corresponding model state; and training a regressor using the plurality of training samples, wherein the trained regressor is configured to infer a model state that corresponds to the face of the subject captured in a frame.