Patent ID: 7190331

Claim:
In a system for augmenting a user's view of real-world objects with virtual objects to provide a composite augmented reality image, the system including a display device for displaying the composite augmented reality image to the user, a tracking system for locating real-world objects, and a processor for determining the position and orientation of the user's view based on the location of the real-world objects, for projecting the virtual objects onto the display device, and for processing a method for determining registration accuracy of the system comprising the steps of: (a) calibrating the tracking system; (b) calibrating the display device; (c) providing an input device for inputting a position of the user's touch; (d) registering the input device with a coordinate system of the system; (e) displaying a virtual object in a known position superimposed on said input device; (f) recording a user's touch position in response to the user attempting to touch the virtual object; (g) calculating a registration error of the system by comparing the user's touch position to the known position of the virtual object; (h) repeating steps (e), (f), and (g), wherein for each repetition of the steps displaying the virtual object in a different known location; and (i) reconstructing an error field of the system by determining residual distances between actual positions of the virtual objects and reconstructed positions of the virtual objects.