Patent ID: 11915130
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method implemented by one or more processors, the method comprising:
training, using Q-learning, a value network to mitigate delusional bias, wherein training the value network to mitigate delusional bias comprises one or both of:
(1) integrating, into the Q-learning used in training the value network, a soft-consistency penalty used to bias Q-labels, across training batches, towards being consistent with an expressible policy; and
(2) generating the value network using a search framework, wherein generating the value network using the search framework comprises:
(a) generating, using the search framework, a plurality of candidate Q-regressors,
(b) selecting a Q-regressor from the plurality of candidate Q-regressors, wherein selecting the Q-regressor is based on determining that the Q-regressor satisfies one or more conditions; and

providing the trained value network for deployment on a robotic and/or other agent.