Patent ID: 11972307
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method implemented by one or more processors, the method comprising:
receiving, by an automated assistant application of a computing device, audio data captured by one or more microphones of the computing device, wherein the audio data captures a spoken utterance of a user who is accessing a given application at the computing device, the given application being accessible separate from the automated assistant application;
processing, by the automated assistant application using an on-device speech recognition engine, the audio data to generate textual data that corresponds to the spoken utterance;
processing, by the automated assistant application using an on-device natural language understanding (NLU) engine, the textual data to generate NLU data that indicates the spoken utterance corresponds to a request for the automated assistant application to interact with the given application using content that is provided by one or more other applications that are different from the given application and different from the automated assistant application;
in response to the NLU data indicating that the spoken utterance corresponds to a request for the automated assistant application to interact with the given application using the content that is provided by the one or more other applications:
generating, based on the textual data and/or the NLU data, an application data request for retrieving the content from the one or more other applications;
providing the application data request to the one or more other applications, wherein the one or more other applications are a subset of a group of applications installed on the computing device, and wherein the one or more other applications include a first application and a second application that are accessible separate from the automated assistant application and the given application,
receiving, from one or more of the other applications, corresponding responsive data that is responsive to the application data request,
generating, by the automated assistant application and based on the responsive data from one or more other applications, content for interacting with the given application, and
providing, by the automated assistant application to the given application, an application command that includes the content and that causes the given application to perform one or more actions based on the content.