Patent ID: 8358320

Claim:
An interactive system for providing a mixed or augmented reality experience to a user, the system comprising: an object having a transcription surface, the transcription surface for receiving a user's transcription; a tracker having a known position and orientation relative to the transcription surface; an image capturing device to capture a 2-dimensional digital image of the tracker and the transcription surface; the tracker having a positioning system for measuring and maintaining orientation and position with the image capturing device; a microprocessor configured to track the position and orientation of the tracker within the image and to calibrate the tracker with the image capturing device and to track the transcription surface by identifying the tracker, the microprocessor configured to identify within the image any transcription made by the user on the transcription surface and retrieve 3-dimensional visual illustration associated with the transcription made by the user, the microprocessor configured to display on a screen the associated 3-dimensional visual illustration superimposed on the image in a relative position to the tracker.