Patent ID: 9734633
Date: 2017-08-15
CPC Classifications: G05B,G06K,G06T,H04M

Claim:
1. A method for visually augmenting an appearance of a physical environment including a real-world object as seen by a user through a transparent display in a head-mounted display device, comprising: receiving eye-tracking information from an eye-tracking system in the head-mounted display device; determining from the eye-tracking information that the user is looking at a virtual object representation; receiving lighting information from an optical sensor system in the head-mounted display device; receiving depth information from the optical sensor system, the depth information including a distance of the real-world object from the head-mounted display device; generating a virtual environment that models the physical environment and is based on the lighting information and the distance of the real-world object from the head-mounted display device, the virtual environment including the virtual object representation and a real-world object representation; visually augmenting the virtual object representation in the virtual environment based on the eye-tracking information that the user is looking at the virtual object representation; rendering the virtual object representation on the transparent display of the head-mounted display device; determining from the eye-tracking information that the user is looking at the real-world object; based on determining that the user is looking at the real-world object, blurring the virtual object representation as seen by the user through the transparent display; analyzing a contrast pattern behind the virtual object representation in the physical environment; and adjusting one or more of a color and a brightness of the virtual object representation to enhance contrast of the virtual object representation with respect to the contrast pattern.