Patent ID: 11908476
Assignee: RABBIT INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system comprising:
a core component configured to perform the following steps in reconciliation loop in a streaming fashion where one or more of the steps may be performed in parallel:
receiving a user input from a user;
segmenting the user input;
performing streaming automatic speech recognition on the user input;
performing streaming large language model (LLM) or natural language processing on the speech recognized user input to generate a first output;
communicating the first output to one or more agents;
receiving a second output form the one or more agents; and
generating a result from the second output from the one or more agents; and
the one or more agents, each configured to imitate user interaction with a corresponding application over a network;
wherein each of the one or more agents comprises:
an intention model configured to translate a user intention into one or more actions without receiving explicit step by step execution instructions from the user;
an interface model in communication with the intention model and configured to translate one or more requests from the intention model into a sequence of user interface (UI) actions on one or more target applications; and
an action executor in communication with the interface model and configured to execute the sequence of UI actions on the one or more target applications.