Patent ID: 9304585
Filing Date: 2016-04-05
CPC Classification: G02B,G06F,G06T,H04N

Claim Text:
1. A substitutional reality system control device, comprising: live video image acquisition means acquiring a live video image that is a video image captured at a given location in an orientation of a head of a viewer in real time; substitutional video image acquisition means acquiring a substitutional video image that is a panoramic or all-around video image supposed to be captured from the given location; cropping orientation updating means updating a cropping orientation to crop a partial video image which is an area corresponding to the orientation of the head from the substitutional video image; and video image switching means switching the video image to be displayed to the head of the viewer by a display device at the given location between the live video image, the substitutional video image, or a composite video image obtained by combining the live video image and substitutional video image, wherein the video image to be displayed by the display device is switched from a first video image to a second video image by applying at least one switching manner selected from the group consisting of: (a) the video image to be displayed is switched when an eye tracker detects rapid eye movement of the viewer; (b) the video image to be displayed is switched when a gaze orientation identifier detects that the viewer pays attention to a predefined object depicted in the first video image and the second video image; (c) the video image to be displayed is switched at a delayed or different timing from another timing at which the viewer specifies; (d) a first object depicted in the first video image fades out or a second object depicted in the second video image fades in, while the video image to be displayed is switched; (e) the video image to be displayed is switched to the live video image when the viewer leaves the given location, and the live video image is displayed while the viewer moves; and (f) the video image to be displayed is switched between the live video image when the viewer stays at the given location; and wherein the video image switching means creates the composite video image by superimposing at least a part of the substitutional video image or live video image before the switching on the substitutional video image or live video image after the switching.