Patent ID: 11907661
Assignee: RICOH COMPANY, LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. The non-transitory computer-readable recording medium as claimed in claim 11,
wherein the named entity recognition model is a self-attention model, and the named entity recognition model includes an attention layer, a feed forward neural network layer, and a span focus layer, a linear layer, and a softmax layer,
wherein input of the attention layer is word embeddings corresponding to the target text, and output of the attention layer is input of the feed forward neural network layer,
wherein output of the feed forward neural network layer is input of the span focus layer, and output of the span focus layer is, Attention
      ⁢
      
        
      
      ⁢
      
        (
        
          Q
          ,
          K
          ,
          V
        
        )
      
    
    =
    
      softmax
      ⁢
      
        
      
      ⁢
      
        (
        
          
            Q
            ⁢
            
              K
              T
            
          
          
            
              d
              
                k
                ⁢
                1
              
            
          
        
        )
      
      *
      Mas
      ⁢
      
        k
        span
      
      *
      V
    
  
  ,, where Q=WQ*H1, K=WK*H1, V=WV*H1, H1 is the output of the feed forward neural network layer, WQ, WK and WV are trainable parameter matrices, Maskspan is the first matrix, and dki is a dimension of an H1 matrix,
wherein the linear layer converts a dimension of the output of the span focus layer, and
wherein the softmax layer normalizes an output result.