Patent ID: 11922096
Assignee: SNAP INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method performed on an augmented reality (AR), mixed reality (MR), or virtual reality (VR) wearable device, the method comprising:
sending a notification to an application that voice user interface (UI) mode is enabled;
receiving, from the application, an indication of a UI element, the UI element indicating a tag and a UI element type;
retrieving an action based on the UI element type from a data structure associating actions with UI element types;
causing to be displayed on a display of the AR, MR, or VR wearable device, a voice UI label for the UI element, the voice UI label comprising the action and the tag;
accessing audio data captured from a microphone of the AR, MR, or VR wearable device, the audio data generated by utterances of a user;
processing the audio data to determine that the audio data comprises the action and the tag; and
sending, to the application, an indication that the UI element is activated.