Patent ID: 11875597
Assignee: IDENTY INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 11:
12. The method of claim 9, wherein the neural network comprises a batch normalizer that provides a normalized reduced matrix P′ to a rectified linear unit and the rectified linear unit applies a rectification function to each entry Pij′ of the normalized reduced matrix P′, wherein the rectification function calculates a new matrix P with entries, P
      _
    
    
      i
      ⁢
      j
    
  
  =
  
    {
    
      
        
          
            0
            ⁢
            
              ∀
              
                
                  P
                  ij
                  ′
                
                <
                0
              
            
          
        
      
      
        
          
            
              P
              ij
              ′
            
            ⁢
            
              ∀
              
                
                  P
                  ij
                  ′
                
                ≥
                0
              
            
          
        
      
    
  

and the matrix P is provided as output to a pointwise convolutional layer of the neural network if the batch normalizer is a first batch normalizer and the rectified linear unit is a first rectified linear unit coupled to the pointwise convolutional layer and the first batch normalizer, or to a next layer of the neural network if the batch normalizer is a second batch normalizer and the rectified linear unit is a second rectified linear unit of the neural network coupled to a second batch normalizer; and/or
wherein the pointwise convolutional layer applies a weight to the matrix I, P, P′ or P received from a preceding layer by multiplying each entry in the matrix P, P′ or P with the weight α.