Patent ID: 9723300
Date: 2017-08-01
CPC Classifications: G02B,G06F,H04N

Claim:
1. An interactive display system, comprising: a user interaction volume; a first display for displaying a first image; a second display for displaying a second image; a first beam combiner positioned at least partway between the first display and the second display, the first beam combiner configured to receive, and to optically overlay, the first and second images, whereby each of the first display and the second display is concurrently devoted to either the left or the right stereo image channel, the first beam combiner comprising: a second beam combiner offset from first beam combiner in the direction of the user interaction volume, the second beam combiner configured to receive, and to optically overlay, the combined first and second images relayed from the first beam combiner with a view of the user interaction volume, the combined two images forming respective stereoscopic left eye and right eye images of a virtual environment, whereby a user looking at the second beam combiner from a user view position perceives the virtual environment reflected from the second beam combiner as originating from within the user interaction volume, the second beam combiner comprising: one or more tracking sensors arranged to sense at least a first input within the user interaction volume and at least a second input within a second volume region, wherein the first input includes position and orientation information of at least one user-controlled object, and wherein the second input includes user viewpoint position and orientation information; and a processor arranged to receive the second input and adapt positioning of the images of the virtual environment so that the virtual environment appears visually aligned with the user interaction volume according to a perspective of the user, the processor further arranged to receive the position and orientation information of the at least one user-controlled object, and determine a corresponding position and orientation in the virtual environment and update the virtual environment based on the corresponding position and orientation.