Patent ID: 8358429

Claim:
A method of interacting with printed content using a handheld display device, said method comprising the steps of: imaging an area of a printed substrate and generating image data using an image sensor of the handheld display device, the imaged area of the printed substrate containing the printed content; determining interaction data using said image data, said interaction data identifying a page description corresponding to at least part of the printed substrate; retrieving display data using the page description, said display data corresponding to at least some of the printed content; displaying, on an opaque touch-sensitive display screen of the handheld display device, display information at least partially based on said display data, wherein the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user's perspective to provide a virtual window to the printed content; and interacting with said display information via said opaque touch-sensitive display screen.