Patent ID: 9491418
Filing Date: 2016-11-08
CPC Classification: G06F,G06T,G09G,H04M,H04N

Claim Text:
1. A method of providing a digitally represented visual instruction relating to an object of interest to a user from a specialist operating a visual instruction device, the visual instruction device comprising a hand of the specialist or an object held by the hand of the specialist, the method comprising the steps of: i. providing a first mobile device associated with the user, the first mobile device having first and second opposed sides and comprising a first camera on the first side of the first mobile device and a first display on the second side of the first mobile device; ii. providing a second mobile device associated with said specialist, the second mobile device having first and second opposed sides and comprising a second camera on the first side of the second mobile device and a second display on the second side of the second mobile device; iii. positioning the first mobile device such that the first camera is directed toward a first scene comprising the object of interest, such that the first display is viewable by the user, and the digitally represented visual instruction is displayed on the first display, such that the first display is provided on a first visual axis between the object of interest and an eye of the user; iv. capturing a first video stream of video images of the first scene by the first camera; v. positioning the second mobile device such that the second camera is directed toward a second scene comprising the visual instruction device and such that the second display is viewable by the specialist, such that the second display is provided on a second visual axis between the visual instruction device and an eye of the specialist; vi. capturing a second video stream of video images of the second scene by the second camera, the second video stream comprising a digital representation of the visual instruction device, the digital representation of the visual instruction device defining the digitally represented visual instruction; vii. generating a third video stream comprising a foreground including the digitally represented visual instruction and a background including the first video stream; viii. displaying the third video stream on the second display, such that the specialist may view the third video stream, and, in response to the third video stream and in order to generate the digitally represented visual instruction, operate the visual instruction device in relation to the object of interest; ix. sending the digitally represented visual instruction to the first mobile device and receiving the digitally represented visual instruction by the first mobile device; and x. displaying the digitally represented visual instruction to the user on the first display.