Patent ID: 11922606
Assignee: SAMSUNG ELECTRONICS CO., LTD.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 14:
15. An electronic computing device comprising:
at least two light sources for simultaneously illuminating a scene, each light source of the at least two light sources emitting structured light having at least one of a spatial pattern, a wavelength or a polarization, wherein the at least one of the spatial pattern, the wavelength or the polarization of each structured light differ from each other, respectively;
an imaging sensor;
a filter array,
wherein one pixel of the imaging sensor captures an image through one filter of the filter array,
wherein the filter array comprises filter sets, a number of the filter sets corresponds to a number of the at least two light sources, one filter set transmits light of only a corresponding one light source of the at least two light sources, sides of each filter of the filter set are adjacent to sides of filters of different filter sets other than the filter set, and
wherein adjacent pixels capturing the image through different filters form a joint pixel, a number of pixels of which is at least equal to the number of the at least two light sources;
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, cause the at least one processor to perform a method for correcting an image of a scene with structured light, the method comprising:
simultaneously illuminating the scene by at least two light sources, each light source of the at least two light sources emitting structured light having at least one of a spatial pattern, a wavelength or a polarization,
wherein the at least one of the spatial pattern, the wavelength or the polarization of each structured light differ from each other, respectively;
capturing an image of the scene simultaneously illuminated by the at least two light sources by an imaging sensor through a filter array,
wherein one pixel of the imaging sensor captures the image through one filter of the filter array,
wherein the filter array comprises filter sets, a number of the filter sets corresponds to a number of the at least two light sources, one filter set transmits light of only a corresponding one light source of the at least two light sources, sides of each filter of the filter set are adjacent to sides of filters of different filter sets other than the filter set, and
wherein adjacent pixels capturing the image through different filters form a joint pixel, a number of pixels of which is at least equal to the number of the at least two light sources;
calculating, for each pixel, intensity values of direct and global components of the light received by the pixel from a system of equations:, {
  
   
    
     
      
       I
       1
      
      =
      
       
        
         b
         1
        
        ×
        
         I
         d
        
       
       +
       
        
         c
         1
        
        ×
        
         I
         g
        
       
      
     
    
   
   
    
     ·
    
   
   
    
     ·
    
   
   
    
     ·
    
   
   
    
     
      
       I
       n
      
      =
      
       
        
         b
         n
        
        ×
        
         I
         d
        
       
       +
       
        
         c
         n
        
        ×
        
         I
         g
        
       
      
     
    
   
  
 

wherein the system of equations is compiled for each joint pixel, and each equation is compiled for one pixel of the pixels in the joint pixel, 1 . . . n is a number of the light source and the pixel receiving the light from the light source, Ix is a total intensity of the light received by a pixel x, bx×Id is the intensity value of the direct component of the light received by the pixel x, cx×Ig is the intensity value of the global component of the light received by the pixel x, bx is a constant calculated in advance when calibrating the imaging sensor with capturing an image of a scene in which light reflection more than one time is absent according to formula, b
    x
   
   =
   
    
     I
     
      d
      x
     
    
    
     I
     
      d
      1
     
    
   
  
  ,
 

Idx is the intensity value of the direct component of the light incident on the pixel x when calibrating, cx is a constant calculated in advance according to formula, c
    x
   
   =
   
    
     P
     x
    
    
     P
     1
    
   
  
  ,
 

Px is a power of the light source, x=1 . . . n, and
wherein the direct component is a component of the light reflected one time from a scene object, and the global component is the component of the light reflected more than one time from the scene object; and
performing for each pixel, image correction by assigning to each pixel its calculated intensity value of the direct component to obtain a corrected image.