Patent ID: 11967178
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. A computer-implemented method for transforming face information, comprising:
receiving a source image that includes data depicting at least a face of a source subject having a source identity, a source pose, and a source expression;
receiving driving information that specifies one or more driving characteristics; and
producing a target image that combines characteristics of the source image and the driving information,
the target image being produced by performing plural instances of warping analysis at plural respective levels of a neural network, the plural instances of warping analysis operating at increasing respective resolutions,
one of the plural instances, corresponding to a current instance of warping analysis, operating at a current-level resolution, and having a preceding instance of warping analysis that operates at a prior-level resolution that is less that the current-level resolution,
the current instance of warping analysis including operations of:
receiving geometric displacement field (GDF) information that describes differences between a source mesh generated based on the source image and a driving mesh generated based on the driving information;
receiving current-level source feature information produced based on the source image, at the current-level resolution;
receiving prior-level realigned feature information that has been produced by the preceding instance of warping analysis, at the prior-level resolution; and
mapping the GDF information, current-level source feature information, and prior-level realigned feature information to current-level realigned feature information, at the current-level resolution.