Patent ID: 11915130
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. The method of claim 12, wherein generating, based on the additional set of search parameters, the one or more additional candidate Q-regressors using the additional expansion phase of the modified beam search framework comprises:
for each parent node in a plurality of parent nodes, wherein the plurality of parent nodes are child nodes generated in the initial expansion phase of the modified beam search framework, and wherein each parent node includes a corresponding regressor and a corresponding ancestor action assignment:
generating a plurality of child nodes by sampling the additional batch of training instances with a Q-regressor of the parent node;
for each child node in the plurality of child nodes:
generating an action assignment for the child node based on the action assignment of the parent node; and
generating a regressor for the child node using a Q-learning update; and

generating the one or more additional candidate Q-regressors based on the generated regressor for the plurality of child nodes.