Patent ID: 9443354
Filing Date: 2016-09-13
CPC Classification: G02B,G06F,G06K,G06T

Claim Text:
1. A mixed reality interaction system for interacting with a physical object in a mixed reality environment, the mixed reality interaction system comprising: a head-mounted display device operatively connected to a computing device, the head-mounted display device including an integrated display system for presenting the mixed reality environment and a plurality of integrated input sensors including a camera for capturing an image of the physical object; and a mixed reality interaction program executed by a processor of the computing device, the mixed reality interaction program configured to: receive a second user input via one of the plurality of integrated input sensors of the head-mounted display device; based on the second user input, change from the first selected interaction mode to a second selected interaction mode from the plurality of interaction modes; receive a third user input directed at the physical object via one of the plurality of integrated input sensors of the head-mounted display device; interpret the third user input to correspond to a second virtual action based on the second selected interaction mode; execute the second virtual action with respect to the virtual object associated with the physical object to thereby modify an appearance of the virtual object; and display the virtual object via the head-mounted display device with a second modified appearance.