Patent ID: 9600936
Date: 2017-03-21
CPC Classifications: G06F,G06T,H04N

Claim:
1. A markerless system for mixing or compositing in real-time, computer generated 3D objects and a video feed from a video camera, to generate real-time augmented reality video, wherein the system includes augmented reality glasses, and wherein the augmented reality glasses include the video camera in which: (a) the body of the video camera can be moved in 3D; (b) sensors, including non-optical sensors such as an accelerometer, and/or gyroscope and/or magnetometer in or attached directly or indirectly to the video camera provide real-time positioning data defining the 3D position and 3D orientation of the video camera, or enabling the 3D position and 3D orientation of the video camera to be calculated; (c) a pair of stereoscopic witness cameras are fixed directly or indirectly to the video camera, the pair of stereoscopic witness cameras being wide-angle stereoscopic witness cameras; (d) that real-time positioning data, and a video flow from each stereo witness camera, is then automatically used by the system to create, recall, render or modify computer generated 3D objects; and (e) the resulting computer generated 3D objects are then mixed in or composited with the video feed from the video camera to provide augmented reality video to the augmented reality glasses.