Patent ID: 11967321
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. A method implemented by one or more processors, the method comprising:
determining, at a computing device, that an application interface of an application is being rendered at a display interface of the computing device,
wherein the application is different from an automated assistant that is accessible via the computing device;

processing, based on the application interface being rendered at the display interface, application data associated with content that is being rendered at the application interface of the application;
generating, based on the processing of the application data, operation data that indicates a correspondence between a feature the application interface and an operation capable of being performed, by the automated assistant, to effectuate control of the application;
receiving, from a user, an input that is directed to the automated assistant,
wherein the input is embodied in a spoken utterance that is provided by the user to an audio interface of the computing device;

determining, based on receiving the input, that the input refers to the operation for interacting with the feature of the application interface; and
causing, in response to receiving the input, the automated assistant to initialize performance of the operation for interacting with the feature of the application interface.