Patent ID: 8214367

Claim:
A system for recording display information, comprising: a virtual display that: intercepts display-changes describing changes to be made to a state of a display; sends the display-changes to a client for display; and records the display-changes; a context recorder that uses accessibility mechanisms to record context information derived independently of screen-images, wherein the accessibility mechanisms include mechanisms utilized by a screen reader for providing desktop access for visually impaired individuals; and wherein the context information includes (1) text that is displayed in at least one application window, (2) a duration in which the text is displayed on the at least one application window and (3) at least one of a font type of the text, a font size of the text, and an identifier of the at least one application window, that are extracted through the accessibility mechanisms; a search tool that: receives a user query from a user; determines whether the user query matches any of the context information; and based on the whether the user query matches any of the context information, determines a correspondence between context information that matched the query and at least one of the display changes; and a display system that: generates an output screen-image based at least in part on the at least one of the display-changes determined to have a correspondence with the context information that matched the query.