Patent Document ID: 9092111
Application ID: 12843863
Patent Status: 1

Claim One:
1. A computer program product for gathering information on a user interface, the computer program product comprising a computer readable storage medium having computer readable program code embodied therein that executes to perform operations within a computer system, the operations comprising: executing a user interface on the computer system; generating an initial representation of a rendered user interface; determining locations rendered in the user interface associated with user activatable content, wherein the user interface renders the user activatable content in response to user selection of the determined locations associated with the user activatable content, wherein the determined locations comprise regions of coordinates in the rendered interface; determining whether the user activatable content is detected at the determined locations; capturing a representation of the user activatable content detected at the determined locations; generating a captured content object for each instance of capturing the representation of the detected user activatable content; saving the captured content objects and the initial representation; and processing the initial representation and the captured content objects to generate output to render the initial representation of the user interface and the representations of the user activatable content in the captured content objects, wherein the captured representations of the user activatable content are rendered superimposed on the initial representation with respect to the determined locations for the captured representations of the user activatable content in the user interface.