Patent ID: 8035848

Claim:
A method of filling in a form using a handheld display device having an image sensor, a transceiver and an opaque touch-sensitive screen, said method comprising: imaging an area of a printed substrate and generating image data using the image sensor, said printed substrate having printed content containing a printed form; determining interaction data using said image data, said interaction data identifying a page description corresponding to the printed substrate; sending the interaction data to a computer system, thereby causing the computer system to identify the page description and retrieve display data corresponding to at least part of said form; receiving the display data from the computer system; displaying, on said opaque touch-sensitive screen, display information based on said display data, such that the opaque touch-sensitive screen has real-time virtual transparency through the screen to the printed content underlying said screen from a user's perspective to provide a virtual window to the printed content underlying said screen, wherein said display information includes at least one displayed form field of said form; and interacting with said at least one displayed form field via said touch-sensitive screen so as to enter form data into said device and cause said page description to be updated with said form data.