Patent ID: 11882299
Assignee: NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H  Y | IPC G  H

Claim 7:
8. The predictive contrastive representation method according to claim 7, wherein the step of optimizing the predictive contrastive loss function by using the direct proportion property between the sampling probability and the similarity to obtain the optimized predictive contrastive loss function comprises:
optimizing the predictive contrastive loss function by using the direct proportion property between the sampling probability and the similarity to obtain the following optimized predictive contrastive loss function:, L
      N
      opt
     
     =
     
     
      
       -
       
        E
        S
       
      
      ⁢
      
       log
       [
       
        
         
          p
          ⁡
          (
          
           
            s
            
             t
             +
             k
            
           
           ⁢
           
            
             ❘
             "\[LeftBracketingBar]"
            
            
             c
             t
            
           
          
          )
         
         
          p
          ⁡
          (
          
           s
           
            t
            +
            k
           
          
          )
         
        
        
         
          
           p
           ⁡
           (
           
            
             s
             
              t
              +
              k
             
            
            ⁢
            
             
              ❘
              "\[LeftBracketingBar]"
             
             
              c
              t
             
            
           
           )
          
          
           p
           ⁡
           (
           
            s
            
             t
             +
             k
            
           
           )
          
         
         +
         
          
           
            ∑
             
           
           
            
             s
             j
            
            ∈
            
             S
             
              n
              ⁢
              e
              ⁢
              g
             
            
           
          
          ⁢
          
           
            p
            ⁡
            (
            
             
              s
              j
             
             ⁢
             
              
               ❘
               "\[LeftBracketingBar]"
              
              
               c
               t
              
             
            
            )
           
           
            p
            ⁡
            (
            
             s
             j
            
            )
           
          
         
        
       
       ]
      
     
    
   
  
  
   
    
     =
     
     
      
       E
       S
      
      ⁢
      
       log
       [
       
        1
        +
        
         
          
           p
           ⁡
           (
           
            s
            
             t
             +
             k
            
           
           )
          
          
           p
           ⁡
           (
           
            
             s
             
              t
              +
              k
             
            
            ⁢
            
             
              ❘
              "\[LeftBracketingBar]"
             
             
              c
              t
             
            
           
           )
          
         
         ⁢
         
          
           ∑
            
          
          
           
            s
            j
           
           ∈
           
            S
            
             n
             ⁢
             e
             ⁢
             g
            
           
          
         
         ⁢
         
          
           p
           ⁡
           (
           
            
             s
             j
            
            ⁢
            
             
              ❘
              "\[LeftBracketingBar]"
             
             
              c
              t
             
            
           
           )
          
          
           p
           ⁡
           (
           
            s
            j
           
           )
          
         
        
       
       ]
      
     
    
   
  
  
   
    
     ≈
     
     
      
       E
       S
      
      ⁢
      
       log
       [
       
        1
        +
        
         
          
           p
           ⁡
           (
           
            s
            
             t
             +
             k
            
           
           )
          
          
           p
           ⁡
           (
           
            
             s
             
              t
              +
              k
             
            
            ⁢
            
             
              ❘
              "\[LeftBracketingBar]"
             
             
              c
              t
             
            
           
           )
          
         
         ⁢
         
          (
          
           N
           -
           1
          
          )
         
         ⁢
         
          E
          
           s
           j
          
         
         ⁢
         
          
           p
           ⁡
           (
           
            
             s
             j
            
            ⁢
            
             
              ❘
              "\[LeftBracketingBar]"
             
             
              c
              t
             
            
           
           )
          
          
           p
           ⁡
           (
           
            s
            j
           
           )
          
         
        
       
       ]
      
     
    
   
  
  
   
    
     =
     
     
      
       E
       S
      
      ⁢
      
       log
       [
       
        1
        +
        
         
          
           p
           ⁡
           (
           
            s
            
             t
             +
             k
            
           
           )
          
          
           p
           ⁡
           (
           
            
             s
             
              t
              +
              k
             
            
            ⁢
            
             
              ❘
              "\[LeftBracketingBar]"
             
             
              c
              t
             
            
           
           )
          
         
         ⁢
         
          (
          
           N
           -
           1
          
          )
         
        
       
       ]
      
     
    
   
  
  
   
    
     ≥
     
     
      
       E
       S
      
      ⁢
      
       log
       [
       
        
         
          p
          ⁡
          (
          
           s
           
            t
            +
            k
           
          
          )
         
         
          p
          ⁡
          (
          
           
            s
            
             t
             +
             k
            
           
           ⁢
           
            
             ❘
             "\[LeftBracketingBar]"
            
            
             c
             t
            
           
          
          )
         
        
        ⁢
        N
       
       ]
      
     
    
   
  
  
   
    
     =
     
     
      
       -
       
        I
        ⁡
        (
        
         
          s
          
           t
           +
           k
          
         
         ,
         
          c
          t
         
        
        )
       
      
      +
      
       log
       ⁡
       (
       N
       )
      
     
    
   
  
 

wherein sneg denotes a set of negative samples, and I(st+k,ct) denotes the mutual information between the temporal coding information at the current moment and the future situational information.