Patent ID: 11915398
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A computer-implemented method of relighting an input image, the method comprising:
receiving a reference image;
generating a reference illumination embedding for the reference image and a reference content embedding for the reference image using a trained neural network by inputting the reference image to an autoencoder of the trained neural network, the autoencoder having an encoder and a decoder that are trained using a spherical harmonic loss function that forces the reference illumination embedding to take a form of spherical harmonics;
receiving the input image, the input image having an illuminated subject; and
generating a relighted image from the input image and the reference illumination embedding using the trained neural network;
wherein generating the relighted image comprises:
generating, by the encoder, an input content embedding that represents the subject of the input image; and
generating, by the decoder, the relighted image using the input content embedding and the reference illumination embedding as inputs to the decoder.