Patent ID: 9600935
Date: 2017-03-21
CPC Classifications: A63F,G06F,G06T,G09G,H04M,H04N

Claim:
1. A method of interacting with a mixed reality, comprising: obtaining, by a mixed reality system, image data relating to a plurality of real-world objects; identifying, by the mixed reality system, a first set of attributes associated with a first real-world object and a second set of attributes associated with a second real-world object from the plurality of real-world objects, based on the image data; obtaining, by the mixed reality system, a first command set for a first real-world object based on the first set of attributes and a second command set for a second real-world object based on the second set of attributes from a distal database storing a plurality of command sets for multiple, mixed reality objects, wherein the first and second command sets comprise command addresses corresponding to commands that control functions of the first and the second real-world objects, respectively; presenting, via a physical computer interface, a virtual interface comprising the first and the second command sets to a user, where at least one of a command from the first command set and a command from the second command set is superimposed on an image of a corresponding real-world interface part of at least one of the corresponding first real-world object and second real-world object, and is configured to stay in proper relation to the at least one of the corresponding first real-world object and second real-world object within a mixed reality view, and wherein the at least one command controls the function associated with the corresponding real-world interface part; and executing, by the mixed reality system, the at least one command from at least one of the first and second command sets upon the user interacting directly with the image of the corresponding real-world interface part by issuing a call to the corresponding command address of the at least one command.