Patent ID: 11949843
Assignee: META PLATFORMS, INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H | IPC H

Claim 7:
8. A system, comprising;
a processor; and
a memory in communication with the processor for storing instructions, which when executed by the processor causes the system to:
capture an image for each flash unit of an electronic device, each image being illuminated during the capturing of the image;
obtain a normalized image from a sequence of illuminated images; and

use an illumination-based optimization framework to generate an enhanced three-dimensional (3D) depth image, the illumination-based optimization framework being based on the illuminated image, wherein the illumination-based optimization framework incorporates the normalized image and 3D depth data associated with the image into the generation of the enhanced 3D depth image and
wherein an enhanced 3D depth field is generated as part of the illumination-based optimization framework, the enhanced 3D depth field being based on the normalized image and the 3D depth data and
wherein each pixel in the normalized image includes an orientation estimation of a surface point corresponding to the pixel in the image and
wherein based upon a determination by the system of whether more than a predetermined number of flash units were utilized for illumination purposes during the capture of each image for each flash unit, a pseudo-inverse processing technique is used to obtain the normal image.