Patent ID: 8171406

Claim:
A computer implemented method for automating user interface navigation, the method comprising the steps of: processing a set of instructions, by a user interface automated navigation system running on a computer, each instruction indicating an action to perform on a user interface; and for at least one instruction in the set, automatically performing the action on the user interface indicated by the instruction, by performing at least the following steps by the user interface automated navigation system running on the computer, wherein the user interface automated navigation system does not have prior information concerning a layout of the user interface, and wherein the user interface automated navigation system does not interact with the user interface by using an automation Application Programming Interface supported by the user interface: identifying a currently selected control on an active window of the user interface, wherein identifying a currently selected control on an active window of the user interface further comprises: capturing a first image of the active window of the user interface; generating at least one input signal configured to change a control focus of the active window of the user interface; sending the at least one generated input signal to the user interface; capturing a second image of the active window of the user interface, after sending the at least one generated input signal to the user interface; and comparing the first image of the active window of the user interface and the second image of the active window of the user interface; determining whether the currently selected control is a control to activate in order to perform the action on the user interface indicated by the instruction; and responsive to whether the currently selected control is a control to activate in order to perform the action on the user interface indicated by the instruction, determining whether to activate the currently selected control.