Patent ID: 11922096
Assignee: SNAP INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by an augmented reality (AR), mixed reality (MR), or virtual reality (VR) wearable device, cause the AR, MR, or VR wearable device to perform operations comprising:
sending a notification to an application that voice user interface (UI) mode is enabled;
receiving, from the application, an indication of a UI element, the UI element indicating a tag and a UI element type;
retrieving an action based on the UI element type from a data structure associating actions with UI element types;
causing to be displayed on a display of the AR, MR, or VR wearable device, a voice UI label for the UI element, the voice UI label comprising the action and the tag;
accessing audio data captured, from a microphone of the AR, MR, or VR wearable device, the audio data generated by utterances of a user;
processing the audio data to determine that the audio data comprises the action and the tag; and
sending, to the application, an indication that the UI element is activated.