Patent Document ID: 8884984
Application ID: 12905952
Patent Status: 1

Claim One:
1. A method for fusing virtual content into real content, comprising: creating a volumetric model of a space; segmenting the model into objects, the segmenting the model into objects includes accessing one or more depth images and accessing one or more visual images, the segmenting the model into objects includes detecting one or more persons using the one or more depth images and the one or more visual images, the segmenting the model into objects includes detecting edges based on the one or more depth images and the one or more visual images, the segmenting the model into objects includes detecting the objects based on the edges and updating the model to store information about the detection of the objects and the one or more persons; identifying one or more of the objects including a first object, the identifying one or more of the objects includes matching at least one of the detected objects to a user identity and accessing a data structure of shapes, the identifying one or more of the objects includes matching one or more of the detected objects to shapes in the data structure and updating the model to reflect the matching of the at least one of the detected objects to the user identity and the matching of the one or more of the detected objects to shapes in the data structure, the identifying one or more of the objects includes visually displaying an unmatched object to a user of a display and requesting the user to identify the unmatched object, the identifying one or more of the objects includes receiving a new identification for the unmatched object and updating the data structure to reflect the new identification, the identifying one or more of the objects includes updating the model to store information about the new identification for the unmatched object; and automatically displaying a virtual image over the first object on the display that allows actual direct viewing of at least a portion of the space through the display.