Patent ID: 11875504
Assignee: UNITY TECHNOLOGIES SF
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer-implemented method for learning a strain-to-skin transformation of a facial action in an animation system, the method comprising:
receiving a plurality of facial scans of a face of an actor representing a plurality of facial movements over a data bundle time period;
generating, from the plurality of facial scans, a data bundle comprising a first cache of a time-varying facial muscle strain vector over the data bundle time period, a second cache of a time-varying skin surface vector over the data bundle time period;
inputting the data bundle and anatomical data corresponding to the actor to a learning model;
generating, by the learning model, a predicted skin surface vector based on the first cache of a time-varying facial muscle strain vector over the data bundle time period and the anatomical data corresponding to the actor;
computing a metric based on the predicted skin surface vector and a ground truth skin surface from the second cache of a time-varying skin surface vector over the data bundle time period; and
updating parameters of the learning model by minimizing the computed metric.