Patent ID: 11947752
Assignee: REALWEAR, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer-implemented method for enabling hands-free operation of a binary touch-based application, the method comprising:
detecting, by a computing device, a user interface tree generated by the binary touch-based application during initialization of the binary touch-based application, the binary touch-based application having a GUI with at least a GUI element;
extracting, by the computing device, a reference that corresponds to the GUI element of the GUI from the user interface tree, the reference including a user interface label of the GUI element;
determining, by the computing device, that the reference corresponding to the GUI element is associated with a customized user interface label, the customized user interface label being different than the user interface label of the GUI element and defined in a customized label index that is separate from the binary touch-based application, wherein the customized label index is user-defined to associate the customized user interface label with the reference;
providing for display, by the computing device, an overlay adjacent to the GUI element based on the determination that the reference is associated with the customized user interface label within the customized label index, the overlay including the customized user interface label; and
emulating, by the computing device, a touch input that corresponds to the GUI element based on a determination that an audio input corresponds to the customized user interface label.