Patent ID: 11914672
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 12:
13. The method of claim 1, wherein the updating comprises:
determining a loss value using the following equation:, ℒ
    
     a
     ⁢
     c
     ⁢
     t
     ⁢
     o
     ⁢
     r
    
   
   =
   
    
     1
     
      
       ❘
       "\[LeftBracketingBar]"
      
      
       B
       R
      
      
       ❘
       "\[RightBracketingBar]"
      
     
    
    ⁢
    
     
      ∑
      
       i
       ∈
       
        B
        R
       
      
     
     
      Q
      ⁡
      (
      
       μ
       ⁡
       (
       
        s
        i
       
       )
      
      )
     
    
   
  
  ,
 

where actor is the loss value of the actor neural network, BR is the batch of training data, and Q(μ(si)) is a predicted reward by critic neural network of each output μ(si) of the actor neural network for a state corresponding to one of the experience tuples of the batch training data BR.