Patent ID: 11947752
Assignee: REALWEAR, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 7:
8. A non-transitory computer storage medium storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations comprising:
detecting a user interface tree generated by a binary touch-based application during initialization of the binary touch-based application, the binary touch-based application having a GUI with at least a GUI element;
extracting a reference that corresponds to the GUI element of the GUI from within the user interface tree, the reference including a user interface label of the GUI element;
determining that the reference corresponding to the GUI element is associated with a customized user interface label, the customized user interface label being different than the user interface label of the GUI element and defined in a customized label index that is separate from the binary touch-based application, wherein the customized label index is user-defined to associate the customized user interface label with the reference;
providing for display an overlay adjacent to the GUI element based on the determination that the reference is associated with the customized user interface label within the customized label index, the overlay including the customized user interface label; and
emulating a touch input that corresponds to the GUI element based on a determination that an audio input corresponds to the customized user interface label.