Patent ID: 11967044
Assignee: SILICON WORKS CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 18:
19. The method of claim 14, further comprising training the convolutional neural network using a predetermined training image,
wherein, when the convolutional neural network is trained, the convolutional neural network is trained using a first loss function defined as an equation, L
   
    smooth
    ⁢
    L
    ⁢
    1
   
  
  =
  
   {
   
    
     
      
       0.5
        
       
        x
        2
       
      
     
     
      
       
        if
        ⁢
           
        
         
          ❘
          "\[LeftBracketingBar]"
         
         x
         
          ❘
          "\[RightBracketingBar]"
         
        
       
       <
       1
      
     
    
    
     
      
       
        
         ❘
         "\[LeftBracketingBar]"
        
        x
        
         ❘
         "\[RightBracketingBar]"
        
       
       -
       0.5
      
     
     
      otherwise
     
    
   
  
 

 and a second loss function defined as an equation, L
    
     relation
      
    
   
   =
   
    
     1
     N
    
    ⁢
    
     
      ∑
      k
      N
     
      
     
      
       ❘
       "\[LeftBracketingBar]"
      
      
       
        relation
        k
        hr
       
       -
       
        relation
        k
        sr
       
      
      
       ❘
       "\[RightBracketingBar]"
      
     
    
   
  
  ,
 

in the equations, x denotes a difference in pixel value between a high-resolution original image with respect to the training image and the high-resolution output image output from the convolutional neural network on a basis of the training image, relationkhr denotes a first similarity between pixels included in the high-resolution original image and is defined as an equation, relation
    k
    HR
   
   =
   
    
     1
     
      C
      ⁡
      (
      
       x
       HR
      
      )
     
    
    ⁢
    
     
      ∑
      
       ∀
       j
      
     
     
      e
      
       
        (
        
         x
         i
         HR
        
        )
       
       
        T
        
         x
         j
         HR
        
       
      
     
    
   
  
  ,
 

 relationksr denotes a second similarity between pixels included in the high-resolution output image and is defined as an equation, relation
    k
    SR
   
   =
   
    
     1
     
      C
      ⁡
      (
      
       x
       SR
      
      )
     
    
    ⁢
    
     
      ∑
      
       ∀
       j
      
     
     
      e
      
       
        (
        
         x
         i
         SR
        
        )
       
       
        T
        
         x
         j
         SR
        
       
      
     
    
   
  
  ,
 

 C(xHR) and C(xSR) denote normalization factors, i denotes a specific pixel in each image, and j denotes all possible pixels in each image.