Patent ID: 11881038
Assignee: KIA CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. The system of claim 10, wherein:
the calculation model of the multi-element attention mechanism is represented by, MEA
      ⁡
      
        (
        X
        )
      
    
    =
    
      
        softmax
        ⁡
        
          (
          
            
              
                AXW
                Q
              
              ⁢
              
                W
                K
                T
              
              ⁢
              
                X
                T
              
              ⁢
              
                B
                T
              
            
            
              D
            
          
          )
        
      
      ⁢
      
        XW
        V
      
    
  
  ,, and here, WQ, WK, and WV are parameter matrices, each dimension is D×D, adjacency matrices A and B are used for modeling the spatial correlation of the feature after mapping by WQ and WK, and the dimension is N×N.