Patent ID: 8589796

Claim:
A user-following interface system comprising: one or more projectors adapted to project one or more images onto one or more selected surfaces in a real environment, wherein the one or more selected surfaces are selected from a plurality of surfaces; a user tracking module adapted to track positions and orientations of one or more users in the real environment; and a controller coupled to the one or more projectors and the user tracking module, the controller adapted to select the one or more selected surfaces and to dynamically determine one or more configuration parameters of the one or more projectors based on the positions and orientations of the one or more users in the real environment, and to provide information to the one or more projectors suitable for allowing the one or more projectors to project the one or more images onto the one or more selected surfaces, wherein each selected surface comprises a display area and wherein the controller is further adapted to select a display area for an image by: mapping the position and orientation of a selected user into a three-dimensional environment model; determining a volume, in the three-dimensional model, that is viewable by the selected user; determining a set of display areas on a set of displayable surfaces in the viewable volume; and selecting one of the display areas; wherein the controller is further adapted to identify occlusion of a projected image, and to move the projected image to a surface that is not occluded.