Patent ID: 11922096
Assignee: SNAP INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. The method of claim 1 wherein the audio data is first audio data, and wherein the method further comprises:
receiving, from the application, indications of UI elements, the UI elements indicating tags and UI element types;
associating the tags with actions corresponding to the UI element types;
capturing, from a microphone of the AR, MR, or VR wearable device, second audio data, the second audio data generated by utterances of the user;
processing the second audio data to generate a transcription of the audio data;
matching the tags and actions with the transcription; and
in response to multiple tags and actions matching the transcription, displaying on the display for each of the multiple tags and actions an indication of what the user should say to select a UI element corresponding to a tag and an action of the multiple tags and actions.