Patent ID: 9128520
Filing Date: 2015-09-08
Classification: G02B,G06F,G06T,G09G

Abstract:
1. A method for use of head-mounted display device worn by a service consumer, the method comprising: receiving image data of a scene from at least one forward-facing camera; obtaining gaze direction data, the gaze direction data indicating a gaze direction of the service consumer; controlling an augmented reality projection system to provide an augmented reality image which highlights one area in the scene corresponding to the gaze direction of the service consumer; receiving a command from the service consumer to mark the gaze direction as a marked gaze direction; and in response to the command, communicating the image data of the scene with the augmented reality image which highlights the one area in the scene to a computing device of a service provider, the service provider generating data to assist the service consumer in performing an activity in the scene; receiving the data generated by the service provider; and controlling the augmented reality projection system based on the data generated by the service provider to project an additional augmented reality image to the service consumer which highlights another area in the scene, to assist the service consumer in performing the activity.