Patent Document ID: 9677840
Application ID: 14211036
Patent Status: 1

Claim One:
1. A method of conducting a real-time augmented reality training session for a trainee, comprising the steps of: mounting a headset to a trainee's head; having the trainee enter a physical environment; producing a first source of binocular video feed of the physical environment, corresponding at least partially to a normal visual field of the trainee from binocular cameras mounted to the headset; and displaying on a binocular display mounted to the headset a second source of binocular video feed to provide binocular imagery to a trainee; wherein the second source of binocular video feed is generated by compositing the first source of binocular video feed of the physical environment with a third source of binocular video feed comprising video game imagery which replaces portions of the first binocular video feed; wherein the portions of the first binocular video feed replaced are identified by a signal in the first binocular video feed or by using machine vision comparisons of the first source of binocular video feed to the third source of binocular video feed, so that the video game imagery and parts of the physical environment are displayed to the trainee on the binocular display without substantial overlap; generating a fourth source of binocular video feed of a traveling matte by extracting portions of the first binocular video feed; and subtracting the fourth source of traveling matte binocular video feed from a fifth source of binocular video feed of video game imagery written on a model of the physical environment to form the third source of binocular video feed; tracking the position of the headset with at least one camera mounted to the headset by imaging indicia written on the physical environment and visible to the at least one tracking camera; creating a CAD model of the physical environment and aligning the CAD model with a tracked position of the headset; producing a sixth source of video feed of the CAD model from a view of the model corresponding to the first source of binocular video feed of the physical environment; creating video game imagery and writing the video game imagery to selected portions of the CAD model of the physical environment and creating the fifth source of binocular video feed corresponding to the view of the model corresponding to the first source of binocular video feed of the physical environment and having the video game imagery written thereon; and wherein the fourth source of traveling matte binocular video is created by comparing the first source of binocular video feed of the physical environment to the sixth source of video feed view of the CAD model to generate the traveling matte from portions of the physical environment which lack correspondence to the CAD model.