Patent ID: 11922323
Assignee: SALESFORCE, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. A computing device comprising:
a memory; and
one or more processors coupled to the memory;
wherein the one or more processors are configured to:
receive a distribution including a plurality of related tasks; and
train parameters for a reinforcement learning neural network model based on gradient estimation associated with the parameters using samples associated with the plurality of related tasks,
wherein control variates are incorporated into the gradient estimation using a combination of a first gradient estimator and a second gradient estimator,
wherein the first gradient estimator uses the control variates and the second gradient estimator does not use the control variates,
wherein the control variates are represented by a baseline function depending on the tasks and corresponding states of the tasks,
wherein the gradient estimation is generated using Hessian estimation, and
wherein a product of two factors for the Hessian estimation based on the first gradient estimator and the second gradient estimator is reduced by subtracting the baseline function from one of the two factors.