Patent ID: 11861263
Assignee: X DEVELOPMENT LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method implemented by one or more processors, the method comprising:
receiving natural language input that includes a request to control a computer application;
generating a request embedding, generating the request embedding being based on processing the natural language input;
processing the request embedding to generate a corresponding measure for each of multiple actions, each of the actions being specific to a domain of the computer application and being implementable through interaction with the computer application;
generating, based on the corresponding measures, multiple candidate action sets for the request, each of the candidate action sets including a respective one of the actions or a respective ordered sequence of multiple of the actions, and each of the action sets being unique relative to all other of the action sets;
for each of the candidate action sets for the request, and prior to any interacting, responsive to the request, with the computer application to control the computer application:
performing a simulation of controlling the computer application using the candidate action set, and
generating, based on simulated data from the simulation, a suitability metric for the candidate action set;

prior to any interacting, responsive to the request, with the computer application to control the computer application, automatically selecting, from the candidate action sets and based on the suitability metrics, a given action set for utilization responsive to the request; and
interacting with the computer application to control the computer application using the selected given action set.