Patent ID: 11922096
Assignee: SNAP INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 2:
3. The method of claim 1 wherein the tag is a first tag, the UI element type is a first UI element type, the UI element is a first UI element, the audio data is first audio data, the utterances are first utterances, and wherein the method further comprises:
determining a second tag and a second UI element type for a second UI element displayed on the display by a legacy application;
associating the second tag with a second action corresponding to the second UI element type;
capturing, from a microphone of the AR, MR, or VR wearable device, second audio data, the second audio data generated by second utterances of the user;
processing the second audio data to determine that the second audio data comprises the second action and the second tag; and
sending, to the legacy application, a second indication that the second UI element is activated.