Patent ID: 8762873

Claim:
A non-transitory computer-readable medium storing computer-executable instructions that when executed by a computer cause the computer to perform a method, the method comprising: identifying, by a device, a set of graphical user interface (GUI) components by at least two of: detecting straight lines in the visual representation of the GUI, where the straight lines create a rectangle enclosing a GUI component; detecting a geometric shape in the visual representation of the GUI, where the geometric shape encloses a GUI component; identifying a frequently used shape in the visual representation of the GUI as a GUI component; matching a region in the visual representation of the GUI to a template describing a commonly used GUI component; identifying a textual GUI component; and identifying sub-components of a GUI component; where the identifying of the set of GUI components is based on screen images that make up a GUI instance and GUI segmentation logic, where the screen images comprise data describing a visual representation of the GUI, and where the set of GUI components comprise one or more GUI elements that facilitate performing a task that the GUI performs; performing segmentation by using GUI segmentation logic, that is not based on any input from a user, to divide the screen images of the GUI into the set of GUI components; providing data identifying the set of GUI components in the screen images; and combining the screen images using the identified set of GUI components into a single screen image of the GUI instance.