IMAGE DISPLAY SYSTEM, INFORMATION PROCESSING APPARATUS, AND IMAGE DISPLAY METHOD

An image display system displays a display image and includes at least one display device and at least one information processing apparatus connected to the display device. The information processing apparatus includes a processor configured to implement an input unit configured to receive image data items and parameters related to the display image, a determination unit configured to determine areas (ARA1, ARA2, ARA3) of an image (D1) indicated by the image data items, which areas are displayed by the display device as partial images of the display image, based on the parameters (DIR1), and a transmission unit configured to transmit data indicating the areas to the display device. The display device is configured to display one of the areas (ARA1) determined by the determination unit at intervals of a predetermined time.

TECHNICAL FIELD

The present disclosure relates to an image display system, an information processing apparatus, and an image display method.

BACKGROUND ART

Conventionally, a display device which performs adjustment according to a supplied image when displaying an image is known in the art. For example, there is known a method for performing a display-related adjustment based on attributes of image data supplied from a mobile terminal, in order to eliminate the necessity of manually operated adjustment or preliminary registration. For example, see Japanese Unexamined Patent Application Publication No. 2013-003327.

Further, there is known a video signal processing method in which, when a video signal input source is switched to another input source, a display adjustment value is switched to a specific display adjustment value according to an external device, which eliminates the necessity of user's manual adjustment operations. For example, see Japanese Unexamined Patent Application Publication No. 2008-033138.

Further, there is known a method in which when content data is displayed, a time to display a setting content data is made to be consistent with a time to actually display the content data. For example, see Japanese Unexamined Patent Application Publication No. 2015-055827.

Further, there is known a method of generating an omnidirectional image by an imaging device, in which an inclination of the imaging device to a vertical direction is detected and a conversion table used for image processing is corrected based on the inclination, to generate the omnidirectional image in which the vertical direction is properly consistent with the inclination of the imaging device.

For example, see Japanese Unexamined Patent Application Publication No. 2013-214947.

CITATION LIST

Patent literature

SUMMARY

Technical Problem

In one aspect, the present disclosure provides an image display system which is capable of displaying one of wide view images at intervals of a predetermined time based on input parameters.

Solution to Problem

In one embodiment, the present disclosure provides an image display system which displays a display image and includes at least one display device and at least one information processing apparatus connected to the display device, the information processing apparatus including a processor configured to implement an input unit configured to receive image data items and parameters related to the display image, a determination unit configured to determine areas of an image indicated by the image data items, which areas are displayed by the display device as partial images of the display image, based on the parameters, and a transmission unit configured to transmit data indicating the areas to the display device, wherein the display device is configured to display one of the areas determined by the determination unit at intervals of a predetermined time.

Advantageous Effects of Invention

The image display system according to one embodiment is capable of displaying one of wide view images at intervals of a predetermined time based on input parameters.

DESCRIPTION OF EMBODIMENTS

A description will be given of embodiments with reference to the accompanying drawings.

First Embodiment

An overall configuration of the image display system according to the first embodiment is explained.FIG. 1illustrates an overall configuration of an image display system1according to the first embodiment. As illustrated inFIG. 1, the image display system1includes a personal computer (PC)11(which is an example of an information processing apparatus) and a projector (which is an example of a display device). In the following, a description will be given of an example of the image display system1including a single PC11and four projectors including a first projector1A, a second projector1B, a third projector1C, and a fourth projector1D as illustrated inFIG. 1.

Image data D1is input to the PC11. For example, the image data D1may be image data indicating an omnidirectional image which is taken by an omnidirectional camera3with a field of view covering all directions of a user200. After the image data D1is input to the PC11, the PC11displays an image on each of the projectors1A,1B,1C, and1D based on the image data D1, and displays a combined image in which the images displayed on the projectors are combined together (which combined image is called a display image) on a screen2.

Note that the image data D1is not restricted to image data indicating still pictures, and it may be image data indicating motion pictures.

It is assumed that optical axes of the four projectors are placed in mutually different directions as illustrated inFIG. 1. For example, the optical axes of the first projector1A, the third projector1C, and the fourth projector1D are parallel to a horizontal direction, and the optical axis of the second projector1B is parallel to a vertical direction perpendicular to the horizontal direction.

In the following, a horizontal direction (equivalent to a depth direction inFIG. 1) indicated by the optical axis of the third projector1C is considered as a front direction, and this direction is set to a Z-axis. Moreover, a right hand horizontal direction (equivalent to a horizontal direction inFIG. 1) to the Z-axis is set to an X-axis. Further, a vertical direction (equivalent to an up/down direction inFIG. 1) perpendicular to the Z-axis and the X-axis is set to a Y-axis. Further, rotation around the X-axis is called Pitch rotation, rotation around the Y-axis is called Yaw rotation, and rotation around the Z-axis is called Roll rotation.

FIG. 2AandFIG. 2Bare diagrams illustrating an example of a display image displayed by the image display system1according to the first embodiment.FIG. 2Ais a plan view of the display image andFIG. 2Bis a side view of the display image. In the following, an angle to which the optical axis of the third projector1C points on the horizontal plane is set to a starting point of a horizontal angle with respect to a Yaw rotation (which angle is called a Yaw angle). At the starting point, the Yaw angle is equal to 0 degrees. On the other hand, an angle to which the optical axis of the third projector1C points on the vertical plane, which angle is parallel to the horizontal plane, is set to a starting point of a vertical angle with respect to a Pitch rotation (which angle is called a Pitch angle). At the starting point, the Pitch angle is equal to 0 degrees. A state where the Pitch angle is equal to 0 degrees is called a vertical state, and the Pitch angle of the optical axis of the second projector1B in the vertical state is equal to 0 degrees.

For example, as illustrated inFIG. 2A, the first projector1A, the third projector1C, and the fourth projector1D display mutually different 120-degrees portions of a display image, so that a combined image in which the image portions are combined together (the display image) is displayed on the screen2.

First, the plan view of the display image illustrated inFIG. 2Awill be described. InFIG. 2A, the third projector1C displays primarily the corresponding image portion where the Yaw angle is in a range of 300 through 360 degrees and in a range of 0 through 60 degrees, the fourth projector1D displays primarily the corresponding image portion where the Yaw angle is in a range of 60 through 180 degrees, and the first projector1A displays primarily the corresponding image portion where the Yaw angle is in a range of 180 through 300 degrees. Note that the image portions displayed by the projectors may overlap each other as illustrated.

Thus, the image portions displayed by the three projectors cover the 120-degree Yaw angle ranges, and the image display system1is capable of displaying a display image which covers the 360-degree Yaw angle range in the horizontal direction.

Next, the side view of the display image illustrated inFIG. 2Bwill be described. InFIG. 2B, each of the first projector1A, the third projector1C, and the fourth projector1D displays primarily the corresponding image portion where the Pitch angle is in a range of 30 through 90 degrees and in a range of 270 through 330 degrees. The second projector1B displays primarily the corresponding image portion where the Pitch angle is in a range of 0 through 30 degrees and in a range of 330 through 360 degrees. Note that the image portions displayed by the projectors may overlap each other as illustrated.

Thus, the image portions displayed by the projectors cover the 60-degree Pitch angle ranges, and the image display system1is capable of displaying a display image which covers the 180-degree Pitch angle range in the vertical direction.

Note that the image portions displayed by the projectors may not be even. Note that the screen2may be a display screen or the like.

Note that the number of display devices included in the image display system1may not be restricted to four, and a different number of display devices may be included in the image display system1. Note that the information processing apparatus included in the image display system1may not be restricted to the PC11, and the information processing apparatus may be any of a server, a mobile PC, a smart phone, and a tablet. Note that the information processing apparatus may be replaced with an information processing system including a plurality of information processing apparatuses, and the information processing system may include a PC and a tablet.

It is preferable that the screen2has a hemispherical shape as illustrated. Namely, it is preferable that an object where a display image is displayed is an object having a hemispherical shape as illustrated. In the present embodiment, the dome-shaped screen2has a hemispherical shape, and the image display system1is capable of displaying a display image which covers the 360-degree Yaw angle range in the horizontal direction when viewed from the center of the hemisphere as illustrated. However, the screen2may not be restricted to the screen having the hemispherical shape, and the screen2may have a different shape.

FIGS. 3A, 3B, and 3Care diagrams illustrating examples of an omnidirectional camera3and an omnidirectional image according to the first embodiment. For example, as illustrated inFIG. 3A, the omnidirectional camera3includes a first lens3H1and a second lens3H2. Each of the first lens3H1and the second lens3H2is implemented by a wide-angle lens or a fisheye lens having a field angle of 180 degrees or more. Namely, the omnidirectional camera3is an example of a camera configured to image a scene covering 360 degrees in the horizontal direction and 360 degrees in the vertical direction of the user200as illustrated inFIG. 3B. Note that the omnidirectional camera3may be implemented by any of an omnidirectional camera, a wide angle camera, a camera using a fisheye lens, and a combination of these cameras.

The omnidirectional camera3generates the image data D1indicating an omnidirectional image. For example, in response to an operation by the user200, the omnidirectional camera3captures an image D2(captured image D2) using the first lens3H1and an image D3(captured image D3) using the second lens3H2simultaneously, each of the images D2and D3covering 180 degrees in the horizontal direction as illustrated inFIG. 3C. Subsequently, the omnidirectional camera3generates the image data D1covering 360 degrees in the horizontal direction of the omnidirectional camera3in which the captured images D2and D3are combined together as illustrated inFIG. 3C. The image data D1is generated by the omnidirectional camera3, and the omnidirectional image indicated by the image data D1may cover 360 degrees in the horizontal direction.

FIG. 4illustrates a hardware configuration of the information processing apparatus (the PC11) according to the first embodiment. As illustrated inFIG. 4, the PC11includes a central processing unit (CPU)11H1, a storage device11H2, an input interface11H3, an input device11H4, an output interface11H5, and an output device11H6.

The CPU11H1is a processor configured to perform various processes and processing of various data and control overall operations of hardware elements of the PC11. Note that the CPU11H1may include an arithmetic unit or a control unit configured to support the operations of the CPU11H1, and the CPU11H1may be implemented by a plurality of units.

The storage device11H2is configured to store data, programs, and setting values. The storage device11H2serves as a memory of the CPU11H1. Note that the storage device11H2may include an auxiliary storage device such as a hard disk drive.

The input interface11H3is an interface configured to receive data, such as the image data D1, and operations by the user200. Specifically, the input interface11H3is implemented by a connector and an external device connected to the PC11via the connector. Note that the input interface11H3may utilize a network or radio communication to receive the data and the operations.

The input device11H4is a device configured to receive command-based operations and data. Specifically, the input device11H4is implemented by a keyboard, a mouse, etc.

The output interface11H5is an interface configured to transmit data from the PC11to the projector. Specifically, the output interface11H5is implemented by a connector and an external device connected to the PC11via the connector. Note that the output interface11H5may utilize a network or radio communication to transmit the data to the projector.

The output device11H6is a device configured to output data. Specifically, the output device11H6is implemented by a display device.

Note that the input device11H4and the output device11H6may be implemented by a touch-panel display in which an input device and an output device are integrated. Alternatively, the input device11H4and the output device11H6may be implemented by another information processing apparatus, such as a smart phone or a tablet.

FIG. 5illustrates a hardware configuration of the display device (projector) according to the first embodiment. Specifically, as illustrated inFIG. 5, each of the first projector1A, the second projector1B, the third projector1C, and the fourth projector1D includes an input interface1AH1, an output device1AH2, a storage device1AH3, a CPU1AH4, and an input device1AH5. In the following, an example in which each of the projectors1A,1B,1C, and1D has an identical hardware configuration will be described.

The input interface1AH1is an interface configured to input data or signals from the PC11to the projector. Specifically, the input interface1AH1is implemented by a connector, a driver, and a dedicated integrated circuit (IC).

The output device1AH2is implemented by optical components, such as lenses, and a light source. The output device1AH2is configured to display an image based on the input data or signals.

The storage device1AH3is configured to store data, programs, and setting values. The storage device1AH3is implemented by a main storage device, such as a memory, an auxiliary storage device such as a hard disk drive, or a combination of the main and auxiliary storage devices.

The CPU1AH4is a processor configured to perform various processes and processing of various data and control overall operations of hardware elements of the projector. Note that the CPU1AH4may include an arithmetic unit or a control unit configured to support the operations of the CPU1AH4, and the CPU1AH4may be implemented by a plurality of units.

The input device1AH5is a device configured to input command-based operations and data. Specifically, the input device1AH5is implemented by a switch, a keyboard, and a mouse.

Each of the projectors1A,1B,1C, and1D is configured to use the input interface1AH1to input data or signals based on image data through a network, radio communication such as near field communication (NFC), or its combination, and display an image. Note that each projector may use a recording medium, such as a universal serial bus (USB) memory, to input the data.

FIG. 6is a sequence diagram for explaining an overall process performed by the image display system according to the first embodiment.

As illustrated inFIG. 6, in step S01, the PC11receives image data items D1. For example, the image data items D1are input from the omnidirectional camera3(FIG. 1) to the PC11.

In step S02, the PC11displays a list of display images to the user200. Note that the processing of step S02is repeatedly performed until an operation to select a display image is performed by the user200.

In step S03, the PC11receives parameters input by the user200. For example, the PC11displays a graphical user interface (GUI), such as a setting screen, and receives the parameters in response to a user's input operation to the setting screen. Note that the parameters may be input in the form of data or commands.

In step S04, the PC11receives a display instruction input by the user200. For example, the operation to input the display instruction may be an operation of pressing a start button or the like on the PC11by the user200.

In step S05, the PC11generates setting data based on the received parameters. The setting data is to be output to the projectors1A through1D.

In step S06, the PC11outputs the setting data generated based on the parameters at the step S05, to each of the projectors1A through1D.

In step S07, each of the projectors1A through1D stores the setting data output from the PC11at the step S06.

In step S08, the PC11outputs display data items for indicating the display image selected by the user200at the step S02, to the projectors1A through1D, respectively.

In step S09, the projectors1A through1D store the display data items output from the PC11at the step S08, respectively.

The processing of steps S08and S09is repeatedly performed until all the display data items are output and stored.

In step S10, the PC11receives a display start instruction input by the user200for starting displaying based on the setting data. In response to the display start instruction, the PC11outputs to each of the projectors1A through1D a message indicating that the uploading is completed, or a message indicating that the displaying is started.

In step S11, each of the projectors1A through1D verifies the setting data stored at the step S07. For example, the verification is made by determining whether the setting data conforms to a predetermined format. When the setting data does not conform to the predetermined format as a result of the verification, each of the projectors1A through1D performs an error process. Note that this error process may be a process which displays an error message.

In step S12, the PC11controls the projectors1A through1D to display the images according to the setting data based on the parameters PAR stored at step S07, so that the display image is switched at intervals of a predetermined time.

Note that the sequence of the above steps S01to S12is not restricted to the sequence illustrated inFIG. 6. For example, the processing of steps S01and S02and the processing of step S03may be performed in reverse sequence or may be performed in parallel. Further, the processing of step S05, the processing of steps S06and S07, and the processing of steps S08and S09may be performed in reverse sequence or may be performed in parallel. Further, the processing of step S11may be performed after the processing of step S07. In addition, all or some of the above steps may be performed simultaneously, in a distributed manner, or redundantly.

FIG. 7AandFIG. 7Billustrate examples of input operations on the information processing apparatus according to one embodiment.

For example, as illustrated inFIG. 7A, the user200performs an operation100on the PC11. In the overall process illustrated inFIG. 6, the operation100is performed by the user in any of step S01, step S03, and step S04.

Further, as illustrated inFIG. 7B, the user200may perform an operation100on a tablet4. The following description will be given with the assumption that the user200performs an input operation on an operation screen displayed on the tablet4.

FIGS. 8A through 8Fillustrate examples of operation screens used to input image data. For example, the tablet4displays an operation screen as illustrated on a touch panel provided in the tablet4. The user touches the touch panel by his fingers or a pen device to perform an input operation on the operation screen.

For example, the tablet4displays a first operation screen PN1illustrated inFIG. 8A. When the user touches the first operation screen PN1illustrated inFIG. 8A, the tablet4displays a second operation screen PN2illustrated inFIG. 8B. The displayed second operation screen PN2includes a list of reduced omnidirectional images (LIST) as illustrated inFIG. 8Bor a list of thumbnail images. Namely, the second operation screen PN2is an example of the list displayed at the step S02illustrated inFIG. 6. Note that the images included in the displayed list are omnidirectional images which are input beforehand to the tablet4(or the information processing apparatus11).

Note that the images may be input from the external device, such as the omnidirectional camera3(FIG. 1). For example, the second operation screen PN2includes a first button BTN1which is used to connect the tablet4to the omnidirectional camera3when the first button BTN1is pressed. Specifically, when the first button BTN1is pressed by the user, the tablet4displays a third operation screen PN3illustrated inFIG. 8C.

The third operation screen PN3may be a guide screen for connecting the tablet4(or the information processing apparatus11) to the omnidirectional camera3as illustrated inFIG. 8C. When the third operation screen PN3is displayed, the user200performs an operation to connect the tablet4to the omnidirectional camera3. When the tablet4is connected to the omnidirectional camera3, the tablet4displays a fourth operation screen PN4illustrated inFIG. 8D.

The fourth operation screen PN4is displayed in list form, similar to the second operation screen PN2illustrated inFIG. 8B, to indicate a list of images (LIST) stored in the omnidirectional camera3. The list of the images (LIST) is displayed as illustrated inFIG. 8D. When an image (first selection image) is selected from among the images of the list by the user200, the tablet4displays a fifth operation screen PN5with the first selection image being focused as illustrated inFIG. 8E.

When a thumbnail image SImg1of the first selection image in the fifth operation screen PN5is pressed, the tablet4displays a preview image Img1of the first selection image.

Alternatively, in the fifth operation screen PN5illustrated inFIG. 8E, an operation to select another image (second selection image) different from the first selection image may be performed by the user200. For example, when a thumbnail image SImg2of the second selection image in the fifth operation screen PN5is pressed, the tablet4displays a sixth operation screen PN6as illustrated inFIG. 8F. In the sixth operation screen PN6, a preview image Img2of the second selection image is displayed as illustrated inFIG. 8F.

Next, various examples in which the parameters are input using the operation screens will be described.

FIGS. 9A through 9Fillustrate examples of operation screens used to input the parameters. For example, it is assumed that the operation screen used to input the parameters is output when a GUI, such as a setup button, included in the fifth operation screen PN5illustrated inFIG. 8E, is pressed. Specifically, when the fifth operation screen PN5includes a setup button BTN2as illustrated inFIG. 9Aand the setup button BTN2is pressed by the user, the tablet4displays a seventh operation screen PN7as illustrated inFIG. 9B.

For example, some of the parameters in the step S03of the overall process ofFIG. 6may be input by a user's input operation to the seventh operation screen PN7. Specifically, a brightness parameter to set up a brightness of a display image may be input using a GUI “exposure compensation” indicated in the seventh operation screen PN7ofFIG. 9B. Further, a contrast parameter to set up a contrast of a display image may be input using a GUI “contrast compensation” indicated in the seventh operation screen PN7ofFIG. 9B. Further, a switch parameter indicating whether to perform a slide show (in which the image data for displaying a display image is switched at intervals of a predetermined time) may be input using buttons “ON” and “OFF” associated with a GUI “slide show” indicated in the seventh operation screen PN7ofFIG. 9B. Note that when a slide show is performed, a time parameter indicating the predetermined time of each interval at which the image data is switched during the slide show is also input as a setting value. In the example ofFIG. 9B, the time parameter indicating “15 seconds” as the setting value for the predetermined time of the interval at which the image data is switched when the slide show is performed is input.

In addition, a horizontal direction parameter indicating one of horizontal directions in which a display image is rotated, and a horizontal rotation speed parameter indicating a rotational speed for rotating the display image in the horizontal direction may be input. Further, a vertical direction parameter indicating one of vertical directions in which a display image is rotated, and a vertical rotation speed parameter indicating a rotational speed for rotating the display image in the vertical direction may be input.

In the following, an example in which the horizontal direction parameter, the horizontal rotation speed parameter, the vertical direction parameter, and the vertical rotation speed parameter are set up by an administrator of the image display system1will be described. Specifically, when a right-hand lower portion BTN3of the second operation screen PN2illustrated inFIG. 8BorFIG. 9Cis held down about 10 seconds, the tablet4displays an eighth operation screen PN8as illustrated inFIG. 9D.

The eighth operation screen PN8is a screen for causing the administrator to enter a password of the administrator as illustrated inFIG. 9D. When a password of the administrator consistent with a registered password of the administrator is entered, the tablet4displays a ninth operation screen PN9as illustrated inFIG. 9E.

The ninth operation screen PN9is an example of a setting of administrator screen. For example, the password of the administrator may be changed using the ninth operation screen PN9. Specifically, when a password change button BTN4in the ninth operation screen PN9is pressed, the tablet4displays a tenth operation screen PN10as illustrated inFIG. 9F.

A new password may be entered using the tenth operation screen PN10. When the new password is entered, the password of the administrator is changed to the new password.

On the other hand, when a display image selection button BTN5in the ninth operation screen PN9illustrated inFIG. 9Eis pressed, the tablet4displays an operation screen in which image data name parameters may be input.

FIG. 10AandFIG. 10Billustrate other examples of the operation screens used to input the parameters. As illustrated inFIG. 10A, an eleventh operation screen PN11is an example of an operation screen used to input the image data name parameters, and the image data name parameters indicate several image data items one of which is sequentially switched to a following image data item at intervals of a predetermined time. Namely, one of several display images indicated by corresponding image data items, boxes of which are checked in the eleventh operation screen PN11, is switched to a following display image at intervals of the predetermined time and the following display image is sequentially displayed. Further, when the several display images are selected in the eleventh operation screen PN11, the tablet4displays a twelfth operation screen PN12illustrated inFIG. 10B.

The twelfth operation screen PN12is an operation screen used to input the horizontal direction parameter, the horizontal rotation speed parameter, the vertical direction parameter, and the vertical rotation speed parameter. For example, the horizontal direction parameter is input using horizontal direction setup buttons BTN6included in the twelfth operation screen PN12, and the vertical direction parameter is input using vertical direction setup buttons BTN7included in the twelfth operation screen PN12. Further, the horizontal rotation speed parameter and the vertical rotation speed parameter are input using rotational speed setup buttons BTN8included in the twelfth operation screen PN12. Further, the setting value for the predetermined time of the interval at which the image data is switched is input using a scroll bar SBA included in the twelfth operation screen PN12.

Furthermore, all the parameters with the above-described parameters may be listed in Table 1 below. In the following, a list of data items including the parameters listed in the Table 1 below will be called a play list. Note that the play list is not required to include all the parameters listed in the Table 1 below, and some of the parameters listed in the Table 1 below may be omitted from the play list. When some of the parameters are omitted, predetermined initial values may be used to set up for such parameters. Further, repeated reproduction in which several display images are switched at intervals of the predetermined time may be set up.

In addition, each of the parameters may be set up for each of the display images, and each of the parameters may be uniformly set up for all or several of the display images. Note that when the display images are motion pictures, the playback time is set up for each of the display images and each of the parameters may be set up based on the playback time.

Further, the method of inputting the parameters is not restricted to the inputting of the parameters using the GUIs. The parameters may be input using commands, text, numerical values, data, or a combination thereof.

TABLE 1NO.PARAMETER NAMESETTING ITEMDETAILS1versionversion of format1.0.0. etc.2orderorder of display images0: designated1: random3contents_listarrangement of display imagesettings displayed in order ofstorage (in case of order: 0)4timeperiod of time for changingdisplay image5effecteffect at a time of changing0: fade-indisplay image1: push to left2: push to right3: wipe to left4: wipe to right5: none6: random6pathstorage destination of displayimage path extension indicatesplayback format7rotation_xrotational angle of horizontalinitial value (0 to 359)direction of display imageabsolute value of angle forimage after zenith correction8rotation_yrotational angle of verticalinitial value (0 to 359)direction of display imageabsolute value of angle forimage after zenith correction9anglescaling ratio of display imageinitial value of angle of view(10 to 100)angle of view decreaseswith its absolute value10auto_rotation_xorientation of rotation of horizontalinitial value of orientation ofdirection of display imageautomatic rotation of horizontaldirectionno rotation: nonerightward rotation: rightleftward rotation: left11auto_rotation_yorientation of rotation of verticalinitial value of orientation ofdirection of display imageautomatic rotation of verticaldirectionno rotation: noneupward rotation: updownward rotation: down12lightnesslightness0 to 100absolute value 0 is the lowest13contrastcontrast0 to 100absolute value 0 is the lowest

In the Table 1 above, the parameter indicated by “No. 1” is an example of a parameter indicating version information.

In the Table 1 above, the parameter indicated by “No. 2” is an example of a parameter to designate the order of images being displayed as display images. Specifically, when several images are selected as illustrated inFIG. 10A(or when the boxes of the several images inFIG. 10Aare checked), the parameter indicated by “No. 2” designates the order of the selected images being displayed.

In the Table 1 above, the parameter indicated by “No. 3” is an example of a contents-list parameter to designate an arrangement of display image settings.

In the Table 1 above, the parameter indicated by “No. 4” is an example of the time parameter to designate the predetermined time of the interval for switching the display images.

In the Table 1 above, the parameter indicated by “No. 5” is an example of the effect parameter to designate the effect at the time of switching the display images. Specifically, the effect parameter is set to one of the values “0” through “6”. For example, if the effect parameter is set to “0”, a fade-in effect is set up at a time of changing the current image to the following image. For example, the fade-in effect may be an effect in which the currently displayed image is darkened gradually to an invisible level, or an effect in which the following image is brightened gradually, or a combination of the two effects.

Further, if the effect parameter is set to “1” or “2”, a push effect is set up in which the currently displayed image is changed to the following image in a manner that the currently displayed image is pushed out. Note that a left or right direction in which the image is pushed out by the push effect is designated by setting the effect parameter to “1” or “2”.

Further, if the effect parameter is set to “3” or “4”, a wipe effect is set up in which the currently displayed image is gradually replaced with the following image. Note that a left or right direction in which the image is replaced by the wipe effect is designated by setting the effect parameter to “3” or “4”.

In the Table 1 above, the parameter indicated by “No. 6” denotes a storage destination of image data. The storage destination is expressed by a path.

In the Table 1 above, the parameter indicated by “No. 7” is an example of a horizontal position parameter which sets up a horizontal direction angle and designates a horizontal position of an area in which a display image is displayed.

In the Table 1 above, the parameter indicated by “No. 8” is an example of a vertical position parameter which sets up a vertical direction angle and designates a vertical position of an area in which a display image is displayed.

In the Table 1 above, the parameter indicated by “No. 9” is an example of a field angle parameter which designates a range in which a display image is displayed by setting up an enlargement or reduction (scaling) rate of the display image.

Namely, when each of the parameters “No. 7” through “No. 9” is input, the area in which the display image is first displayed is designated.

In the Table 1 above, the parameter indicated by “No. 10” is an example of a horizontal direction parameter indicating an orientation of horizontal directions in which a display image is rotated in the horizontal direction.

In the Table 1 above, the parameter indicated by “No. 11” is an example of a vertical direction parameter indicating an orientation of vertical directions in which a display image is rotated in the vertical direction.

In the Table 1 above, the parameter indicated by “No. 12” is an example of the brightness parameter which sets up a brightness of a display image.

In the Table 1 above, the parameter indicated by “No. 13” is an example of the contrast parameter which sets up a contrast of a display image.

Note that the parameters may include a switching condition parameter to set up the switching condition. Note that the parameters may further include a vertical rotation speed parameter indicating a speed of rotation in a vertical direction, and a horizontal rotation speed parameter indicating a speed of rotation in a horizontal direction.

Further, the switching condition is not restricted to a switching condition related to the horizontal direction. For example, the switching condition may be a switching condition related to the vertical direction. Moreover, the switching condition may be a combination of the switching condition related to the vertical direction and the switching condition related to the horizontal direction.

If a user inputs to the tablet4the parameters as illustrated in the Table 1 above using the operation screens illustrated inFIGS. 8A through 10B, the tablet4transmits a play list to the PC11(FIG. 1). Namely, the step S03of the overall process ofFIG. 6is implemented by the user's operation to the operation screens illustrated inFIGS. 8A through 10B, and the transmission of the play list to the PC11.

FIG. 11illustrates an example of the play list. As illustrated inFIG. 11, the play list PLS may be generated in the format of JavaScript Object Notation (JSON), for example. In the following, the example of the play list PLS which is generated in the format of JSON will be described. Note that the play list PLS may be generated in a different format.

The parameter indicated by “No. 1” in the Table 1 above is input like a first parameter “PAR1” in the play list PLS.

The parameter indicated by “No. 2” in the Table 1 above is input like a second parameter “PAR2” in the play list PLS.

The parameter indicated by “No. 4” in the Table 1 above is input like a fourth parameter “PAR4” in the play list PLS.

The parameter indicated by “No. 5” in the Table 1 above is input like a fifth parameter “PAR5” in the play list PLS.

The parameter indicated by “No. 6” in the Table 1 above is input like a sixth parameter “PAR6” in the play list PLS.

The parameter indicated by “No. 7” in the Table 1 above is input like a seventh parameter “PAR7” in the play list PLS.

The parameter indicated by “No. 8” in the Table 1 above is input like an eighth parameter “PAR8” in the play list PLS.

The parameter indicated by “No. 9” in the Table 1 above is input like a ninth parameter “PAR9” in the play list PLS.

The parameter indicated by “No. 10” in the Table 1 above is input like a tenth parameter “PAR10” in the play list PLS.

The parameter indicated by “No. 11” in the Table 1 above is input like an eleventh parameter “PAR11” in the play list PLS.

The parameter indicated by “No. 12” in the Table 1 above is input like a twelfth parameter “PAR12” in the play list PLS.

The parameter indicated by “No. 13” in the Table 1 above is input like a thirteenth parameter “PAR13” in the play list PLS.

FIG. 12AandFIG. 12Billustrate an example of a horizontal direction processing result of the overall process by the image display system1according to one embodiment. In the following, a case in which some of areas of an image indicated by image data D1illustrated in the upper portion ofFIG. 12Aare displayed as a display image will be described.

First, the horizontal direction processing will be described. When the horizontal position parameter and the field angle parameter are input by the play list PLS (FIG. 11), the areas of the image indicated by the image data D1in the horizontal direction, which are displayed by the projectors1A through1D, are determined. For example, based on the horizontal position parameter and the field angle parameter, the PC11determines that the third projector1C (FIG. 1) is to display a first area ARA1in the image indicated by the image data D1. In this case, a partial image indicating the first area ARA1is displayed by the third projector1C and a vertical centerline of the image is situated around the location where the Yaw angle is 0 degrees as illustrated inFIG. 12B.

Similarly, based on the horizontal position parameter and the field angle parameter, the PC11determines that the first projector1A (FIG. 1) is to display a second area ARA2in the image indicated by the image data D1. In this case, a partial image indicating the second area ARA2is displayed by the first projector1A and a vertical centerline of the image is situated around the location where the Yaw angle is 240 degrees as illustrated inFIG. 12B.

Further, based on the horizontal position parameter and the field angle parameter, the PC11determines that the fourth projector1D (FIG. 1) is to display a third area ARA3in the image indicated by the image data D1. In this case, a partial image indicating the third area ARA3is displayed by the fourth projector1D and a vertical centerline of the image is situated around the location where the Yaw angle is 120 degrees as illustrated inFIG. 12B.

The partial images indicating the first area ARA1, the second area ARA2, and the third area ARA3based on the image data D1are displayed by the projectors1C,1A, and1D, respectively, and the image display system1is able to output the display image covering 360 degrees in the horizontal direction around a viewpoint PS indicated inFIG. 12B. Namely, when the horizontal position parameter and the field angle parameter are input, the image display system1is able to determine that the partial images of the first area ARA1, the second area ARA2, and the third area ARA3are to be output as the display image covering 360 degrees in the horizontal direction around the viewpoint PS. Further, the display image covering 360 degrees in the horizontal direction is generated by combining the partial images of the first area ARA1, the second area ARA2, and the third area ARA3.

Here, suppose that setting to rotate the display image in a first direction DIR1as indicated inFIG. 12Ais requested by the horizontal direction parameter. In this case, the image display system1is configured to change the first area ARA1, the second area ARA2, and the third area ARA3at intervals of a predetermined time. Specifically, it is assumed that the three areas are initially determined as illustrated in the upper portion ofFIG. 12A, and the predetermined time has elapsed after the display image is displayed based on the determined areas. At this time, the image display system1changes the three areas in the first direction DIR1, respectively, as illustrated in the lower portion ofFIG. 12A. Then, the image display system1outputs a display image based on the changed areas illustrated in the lower portion ofFIG. 12A.

Similar to the change illustrated inFIG. 12A, the image display system1repeatedly changes the three areas in the first direction DIR1at intervals of the predetermined time. Namely, when the predetermined time has elapsed again after the display image is displayed as illustrated in the lower portion ofFIG. 12A, the image display system1further changes the three areas illustrated in the lower portion ofFIG. 12Ain the first direction DIR1.

When the three areas illustrated in the upper portion ofFIG. 12Aare changed to the three areas illustrated in the lower portion ofFIG. 12A, the images displayed by the projectors are changed so that the display image is changed. A Yaw rotation of the display image in a second direction DIR2is viewed from the viewpoint PS as illustrated inFIG. 12B. Namely, the image display system1is configured to change the three areas in the first direction DIR1at intervals of the predetermined time based on the horizontal direction parameter, to allow the rotation of the display image in the horizontal direction (the Yaw rotation).

Note that the positions of the first area ARA1, the second area ARA2, and the third area ARA3in the horizontal direction (the X coordinates thereof) as illustrated inFIG. 12Amay be designated by the horizontal position parameter, such as the parameter indicated by “No. 7” in the Table 1 above. Namely, the horizontal position parameter is a parameter to designate initial values of the X coordinates of the areas in the X axis.

Further, the range of each of the first area ARA1, the second area ARA2, and the third area ARA3(the number of pixels or the amount of space of each area) as illustrated inFIG. 12Amay be designated by the field angle parameter, such as the parameter indicated by “No. 9” in the Table 1 above. Namely, the field angle parameter is a parameter to designate the range of each area.

Further, the first direction DIR1in which the first area ARA1, the second area ARA2, and the third area ARA3are changed as illustrated inFIG. 12Amay be designated by the horizontal direction parameter, such as the parameter indicated by “No. 10” in the Table 1 above. Note that if a horizontal direction parameter designating a horizontal direction opposite to the first direction DIR1illustrated inFIG. 12Ais input, the image display system1causes the rotation (the Yaw rotation) of the display image in the counterclockwise direction opposite to the second direction DIR2illustrated inFIG. 12B.

Further, the frequency of changing the first area ARA1, the second area ARA2, and the third area ARA3and the amount of a rotational angle or the predetermined period for changing these areas as illustrated inFIG. 12Amay be designated by the horizontal rotation speed parameter. For example, a horizontal rotation speed parameter indicating 36 degrees per second may be input. In this case, the three areas are changed at intervals of one second so that the display image is rotated by the rotational angle of 36 degrees per second. After 10 seconds have elapsed, the display image is rotated by the rotational angle of 360 degrees. Namely, the display image is rotated by one revolution after 10 seconds.

Further, if a relatively great amount of the rotational angle for changing the areas in the first direction DIR1as illustrated inFIG. 12Ais input, the amount of change of each area becomes great. In this case, the Yaw rotation of the display image when viewed from the viewpoint PS illustrated inFIG. 12Btakes place quickly. Hence, by inputting an appropriate horizontal rotation speed parameter, it is possible for the image display system1to adjust the speed of rotation (the Yaw rotation) of the display image in the horizontal direction.

Next, a vertical direction processing result will be described.FIG. 13AandFIG. 13Billustrate an example of the vertical direction processing result of the overall process by the image display system according to one embodiment. In the following, a case in which some of areas of an image indicated by the image data D1illustrated in the left-hand portion ofFIG. 13Aare displayed as a display image will be described.

If the vertical position parameter and the field angle parameter are input by the play list PLS (FIG. 11), the areas of the image indicated by the image data D1in the vertical direction and to be displayed by the projectors1A through1D are determined. For example, based on the vertical position parameter and the field angle parameter, the PC11determines that the first projector1A (FIG. 1), the third projector1C (FIG. 1), and the fourth projector1D (FIG. 1) are to display a fourth area ARA4in the image indicated by the image data D1. In this case, a partial image indicating the fourth area ARA4is displayed by the first projector1A, the third projector1C, and the fourth projector1D and a horizontal centerline of the image is situated in the range in which the Pitch angle is “30 through 90 degrees” and “270 through 330 degrees” as illustrated inFIG. 13B.

Similarly, based on the vertical position parameter and the field angle parameter, the PC11determines that the second projector1B (FIG. 1) is to display a fifth area ARA5in the image indicated by the image data D1. In this case, a partial image indicating the fifth area ARA5is displayed by the second projector1B and a horizontal centerline of the image is situated in the range in which the Pitch angle is “0 through 30 degrees” and “330 through 360 degrees” as illustrated inFIG. 13B.

The partial images indicating the fourth area ARA4and the fifth area ARA5are displayed by the projectors1A,1C,1D and the projector1B, respectively, and it is possible for the image display system1to output the display image covering 180 degrees in the vertical direction from a viewpoint PS indicated inFIG. 13B. Namely, when the vertical position parameter and the field angle parameter are input, the image display system is able to determine that the partial images of the fourth area ARA4and the fifth area ARA5are to be output as the display image covering 180 degrees in the vertical direction.

Here, suppose that setting to rotate the display image in a third direction DIR3indicated inFIG. 13Ais requested by the vertical direction parameter. In this case, the image display system is configured to change the fourth area ARA4and the fifth area ARA5at intervals of a predetermined time. Specifically, it is assumed that the two areas are initially determined as illustrated in the left-hand portion ofFIG. 13A, and the predetermined time has elapsed after the display image is displayed based on the determined areas. At this time, the image display system1changes the two areas in the third direction DIR3, respectively, as illustrated in the right-hand portion ofFIG. 13A. Then, the image display system1outputs a display image based on the changed areas as illustrated in the right-hand portion ofFIG. 13A.

Similar to the change illustrated inFIG. 13A, the image display system1repeatedly changes the two areas in the third direction DIR3at intervals of the predetermined time. Namely, when the predetermined time has elapsed after the display image is displayed as illustrated in the right-hand portion ofFIG. 13A, the image display system1further changes the two areas illustrated in the right-hand portion ofFIG. 13Ain the third direction DIR3.

When the two areas illustrated in the left portion ofFIG. 13Aare changed to the areas illustrated in the right portion ofFIG. 13A, the images displayed by the projectors are changed so that the display image is changed. A Pitch rotation of the display image in a fourth direction DIR4is viewed from the viewpoint PS illustrated inFIG. 13B. Namely, the image display system1is configured to change the two areas in the third direction DIR3at intervals of the predetermined time based on the vertical direction parameter, to allow the rotation of the display image in the vertical direction (the Pitch rotation).

Note that the positions of the fourth area ARA4and the fifth area ARA5in the vertical direction (the Y coordinates thereof) as illustrated inFIG. 13Amay be designated by the vertical position parameter, such as the parameter indicated by “No. 8” in the Table 1 above. Namely, the vertical position parameter is a parameter to designate initial values of the Y coordinates of the areas in the Y-axis.

Further, the range of each of the fourth area ARA4and the fifth area ARA5(the number of pixels or the amount of space of each area) as illustrated inFIG. 13Amay be designated by the field angle parameter, such as the parameter indicated by “No. 9” in the Table 1 above. Namely, the field angle parameter is a parameter to designate the range of each area.

Further, the third direction DIR3in which the fourth area ARA4and the fifth area ARA5are changed as illustrated inFIG. 13Amay be designated by the vertical direction parameter, such as the parameter indicated by “No. 11” in the Table 1 above. Note that if a vertical direction parameter designating a vertical direction opposite to the third direction DIR3illustrated inFIG. 13Ais input, the image display system1causes the rotation (the Pitch rotation) of the display image in the clockwise direction opposite to the fourth direction DIR4illustrated inFIG. 13B.

Further, the frequency of changing the fourth area ARA4and the fifth area ARA5and the amount of the rotational angle or the predetermined period for changing these areas as illustrated inFIG. 13Amay be designated by the vertical rotation speed parameter. For example, if a vertical rotation speed parameter designating a relatively great amount of the rotational angle for changing the areas in the third direction DIR3as illustrated inFIG. 13Ais input, the amount of change of each area becomes great. In this case, the Pitch rotation of the display image when viewed from the viewpoint PS illustrated inFIG. 13Btakes place quickly. Hence, by inputting an appropriate vertical rotation speed parameter, it is possible for the image display system1to adjust the speed of rotation (the Pitch rotation) of the display image in the vertical direction.

Note that combining the horizontal direction rotation and the vertical direction rotation may allow the rotation of the display image in an oblique direction.

FIG. 14is a block diagram illustrating a functional configuration of the image display system1according to the first embodiment. As illustrated inFIG. 15, the image display system1may include an input unit1F1, a determination unit1F2, and a change unit1F3.

The input unit1F1is configured to receive the image data D1and the parameters PAR related to a display image. Note that the input unit1F1may be implemented by the input interface11H3(FIG. 4), the input device11H4(FIG. 4), or the tablet4(FIG. 7B).

The determination unit1F2is configured to determine areas of an image indicated by the image data D1, which are displayed by the display devices (the projectors1A through1D) as partial images of the display image, based on the parameters PAR received by the input unit1F1. Note that the determination unit1F2may be implemented by the CPU11H1(FIG. 4).

The change unit1F3is configured to change the areas at intervals of the predetermined time based on the parameters PAR received by the input unit1F1, so that the display image is changed. Note that the change unit1F3may be implemented by the CPU11H1(FIG. 4).

The above units represent functions and units of the image display system1implemented by any of the elements and devices illustrated inFIG. 4, which are activated by instructions from the CPU11H1based on the programs stored in the storage device11H2.

When the areas which are displayed by the display devices are determined based on the parameters PAR received by the input unit1F1, the image display system1is able to display the display image by combining the partial images output by the display devices. The areas are determined by the determination unit1F2based on the parameters. Then, the change unit1F3changes the areas at intervals of the predetermined time based on the parameters. Similar to the examples ofFIGS. 12A through 13B, when the areas are determined or changed at intervals of the predetermined time, the image display system1is able to display the display image at intervals of the predetermined time. Hence, the display image is output by the image display system1such that a rotation of the display image is viewed. The image display system is capable of switching the display image at intervals of the predetermined time based on the parameters.

Further, the direction of rotation of the display image or the rotational speed of the display image may be set up by the parameters PAR.

Second Embodiment

Next, an overall process by an image display system1according to a second embodiment is explained. In one aspect, the second embodiment provides an image display system which is capable of displaying, when displaying a wide view image such as an omnidirectional image, a user's desired area of the wide view image. The image display system1according to the second embodiment may be implemented by the image display system1according to the first embodiment. In the following, an example in which the image display system1which is essentially the same as the above-described image display system1of the first embodiment is utilized will be described. Hence, a description of a hardware configuration of the image display system1according to the second embodiment will be omitted.

FIG. 15is a flowchart for explaining the overall process by the image display system1according to the second embodiment.

As illustrated inFIG. 15, in step S01, the image display system1displays a display image based on image data. Note that the image data is received beforehand by the image display system1.

In step S02, the image display system1waits for an operation input by a user. When the operation input by the user is received, the image display system1goes to step S03.

In step S03, the image display system1determines whether the received operation is a vertical reduction operation to reduce the display image vertically. When it is determined that the received operation is the vertical reduction operation (YES in step S03), the image display system1goes to step S04. On the other hand, when it is determined that the received operation is not the vertical reduction operation (NO in step S03), the image display system1goes to step S05.

In step S04, the image display system1partially or fully reduces the image indicated by the image data and displays the reduced image.

In step S05, the image display system1determines whether the received operation is a rotation operation to rotate the display image. When it is determined that the received image is the rotation operation (YES in step S05), the image display system goes to step S06. On the other hand, when it is determined that the received operation is not the rotation operation (NO in step S05), the image display system1terminates the overall process ofFIG. 15. Note that, when it is determined that the rotation operation is not received, the image display system1may perform various other processes based on the received operation.

In step S06, the image display system1determines whether the image is reduced vertically. When it is determined that the image is reduced vertically (YES in step S06), the image display system1goes to step S07. On the other hand, when it is determined that the image is not reduced vertically (NO in step S06), the image display system1goes to step S08.

In step S07, the image display system1partially or fully perform nonmagnification of the image indicated by the image data. Note that the image display system1may be configured to enable the user to set up whether to perform the nonmagnification of the image.

In step S08, the image display system1rotates the display image and displays the rotated image.

FIGS. 16A and 16Billustrate a processing result of the overall process by the image display system according to the second embodiment. Specifically,FIGS. 16A and 16Billustrate an example of a processing result of step S04in the overall process ofFIG. 15. In the following, an example in which a first image Img1as illustrated inFIG. 16B, which is an omnidirectional image indicated by the image data, is initially received will be explained. Further, an output range OUT indicated in the left portion ofFIG. 16Bis equivalent to the display image displayed on the screen2. Namely, in the following example, an image area included in the output range OUT is an image area displayed as the display image. Suppose that the user desires to display a photographic image in which a particular emphasis is put on faces of people taken in the photographic image.

If the first image Img1as illustrated in the left portion ofFIG. 16Bis displayed as the display image, the photographic subject (the faces of the people in the first image Img1) may not fully or partially be displayed on the screen2. Specifically, in this example, the faces of the people in the first image Img1are situated below the output range OUT as illustrated in the left portion ofFIG. 16B, and they are hardly displayed as the display image.

To avoid this, the user performs an operation to change the area displayed in the display image. For example, the user performs an operation to reduce the image in the vertical direction (Y-axis direction). Next, when the vertical reduction operation is received (YES in step S03in the process ofFIG. 15), the image display system1generates a reduced image Img2as illustrated in the middle ofFIG. 16A. Specifically, the reduced image Img2is generated by partially or fully reducing the first image Img1, so that the user's desired area may be displayed. Namely, as illustrated in the left portion ofFIG. 16B, the first image Img1is reduced and the reduced image Img2is generated such that the photographic subject in the first image Img1which the user desires to display is placed within the output range OUT. Hence, the image display system is able to display the user's desired photographic subject as the display image (step S04in the process ofFIG. 15).

FIG. 17illustrates an example of rotation of a reduced image by the image display system1according to the second embodiment. As illustrated inFIG. 17, the image display system1receives a rotation operation to rotate the reduced image Img2which is performed by the user. When the rotation operation is received (YES in step S05in the process ofFIG. 15), the image display system1is able to display the area as the display image, which area has not been sufficiently displayed before the rotation operation is performed.

FIG. 18illustrates an example of generation of a nonmagnified image by the image display system according to the second embodiment. In the following, an example in which the reduced image is generated (YES in step S06in the process ofFIG. 15) similar toFIG. 16Aand an operation to rotate the image is received (YES in step S05ofFIG. 15) as illustrated inFIG. 17will be described. Note that the operation may include at least a vertical rotation operation (Pitch rotation), and may also include a vertical rotation operation (Pitch rotation) combined with a horizontal rotation operation (Yaw rotation) (i.e., an oblique direction rotation operation).

In this example, the image display system1generates a nonmagnified image Img3in which the vertically reduced portion thereof is partially or fully nonmagnified. For example, the nonmagnified image Img3is generated to have a magnification rate that is the same as that of the first image Img1by resetting the reduction state of the reduced image Img2illustrated inFIG. 16A(step S07ofFIG. 15).

Note that the nonmagnification is not restricted to the process which converts the reduced image Img2to have the magnification rate that is the same as that of the first image Img1. For example, the nonmagnification may be a process which converts the reduced image Img2to have a magnification rate such that the image indicated by the predetermined pixels PIX (FIG. 16A) is hardly noticeable even when displayed with the display image.

Further, the nonmagnification process may be performed based on the received image data. Specifically, when a reduced image is generated, the received image data (i.e., the image data indicating the image before the reduction process is performed) is copied and stored. Subsequently, the nonmagnified image Img3may be generated by using the stored image data indicating the image before the reduction process is performed. Namely, the image display system1retains the image data with the original scaling rate nonmagnified in performing the reduction process. In this case, after the nonmagnified image Img3is generated based on the image data, the image display system1is able to generate the nonmagnified image Img3.

Subsequently, the image display system1displays a display image based on the nonmagnified image Img3as illustrated in the middle ofFIG. 18(step S08ofFIG. 15). Specifically, as illustrated in the middle ofFIG. 18, the image display system1rotates the nonmagnified image Img3in response to the received rotation operation, and displays the display image on the screen2.

As illustrated inFIGS. 16A and 16B, the image indicated by the predetermined pixels PIX may be included in the reduced image Img2. Note that the predetermined pixels PIX are situated outside the field angle of the first lens3H1(FIG. 3) or the second lens3H2(FIG. 3), and the image data received does not include the predetermined pixels. Further, the predetermined pixels may be the pixels existing in a range set up by the user.

When the display image is displayed based on the nonmagnified image Img3in response to reception of the rotation operation as illustrated inFIG. 18, the image display system is able to display the display image so as to prevent the image indicated by the predetermined pixels PIX (FIG. 16A) from being displayed. Note that a magnification process may be performed instead of the nonmagnification process.

COMPARATIVE EXAMPLE

FIGS. 19A and 19Billustrate an example of a display image according to a comparative example. In the following, the comparative example when the reduced image Img2is generated as illustrated inFIG. 16Aand an operation to rotate the reduced image is received, similar to the example ofFIG. 18, will be described. Further, suppose that the rotation operation as illustrated inFIG. 19Bis received.

If the display image is displayed based on the reduced image Img2, the image indicated by the predetermined pixels PIX appears in the output range OUT as illustrated inFIG. 19B, and the image indicated by the predetermined pixels PIX will be displayed with the display image.

Third Embodiment

Next, an image display system1according to a third embodiment may be implemented by the image display system1according to the second embodiment. In the following, an example in which the image display system which is essentially the same as the above-described image display system of the second embodiment is utilized will be described. Hence, a description of a hardware configuration of the image display system1according to the third embodiment will be omitted and only the difference between the third embodiment and the second embodiment will be described. Namely, an overall process performed by the image display system1according to the third embodiment differs from the overall process performed by the image display system according to the second embodiment.

FIG. 20is a flowchart for explaining the overall process by the image display system1according to the third embodiment. The overall process illustrated inFIG. 20differs from the overall process illustrated inFIG. 15in that the overall process illustrated inFIG. 20additionally includes steps S20through S23. In the following, the different points will be explained.

In step S20, the image display system1determines whether the image indicated by the predetermined pixels is included in the display area. When it is determined that the image indicated by the predetermined pixels is included in the display area (YES in step S20), the image display system1goes to step S21. On the other hand, when it is determined that the image indicated by the predetermined pixels is not included in the display area (NO in step S20), the image display system1goes to step S08.

In step S21, the image display system1determines whether all of the predetermined pixels are included in the display area. When it is determined that all of the predetermined pixels are included in the display area (YES in step S21), the image display system1goes to step S07. On the other hand, when it is determined that all of the predetermined pixels are not included in the display are (NO in step S21), the image display system1goes to step S22.

In step S22, the image display system1determines whether some of the predetermined pixels are included in the display area. When it is determined that some of the predetermined pixels are included in the display area (YES in step S22), the image display system1goes to step S23. On the other hand, when it is determined that some of the predetermined pixels are not included in the display area (NO in step S22), the image display system1goes to step S08.

In step S23, the image display system1changes the reduction rate.

FIGS. 21A and 21Billustrate a processing result of the overall process performed by the image display system1according to the third embodiment.

For example, suppose that a reduced image is displayed at step S04of the overall process ofFIG. 20and a vertical rotation operation to the reduced image is received from the user. There may be a case in which the image indicated by the predetermined pixels PIX partially appears on the screen2as illustrated inFIG. 21A. This is readily understood from an X-Y cross-sectional view illustrated in the left portion ofFIG. 21B. As illustrated in the left portion ofFIG. 21B, a partial image PIXP of the image indicated by the predetermined pixels PIX may appear in an output range OUT. Hence, if the image illustrated in the middle ofFIG. 21Ais displayed as the display image, the partial image PIXP will also appear with the display image.

When the partial image PIXP appears in the output range OUT, the image display system1determines that some of the predetermined pixels are included in the display area (YES in step S22ofFIG. 20). Then, the image display system1changes the reduction rate at step S23ofFIG. 20.

In the example illustrated in the left portion ofFIG. 21B, the image display system1changes the reduction rate so that a changed image Img4as illustrated in the right portion ofFIG. 21Bis displayed as the display image according to the changed reduction rate. Supposing that “A” denotes an angle of a range where the image indicated by the predetermined pixels PIX exists and “B” denotes an angle of a range where the remainder of the image other than the partial image PIXP exists, the reduction rate of the reduced image Img2is represented by “(360 degrees−A)/360 degrees”.

As illustrated in the right portion ofFIG. 21B, the image display system1generates the nonmagnified image of the portion of the partial image PIXP to prevent the partial image PIXP from being displayed. Namely, the image display system1changes the reduction rate so as to eliminate the portion corresponding to the angle B. In this case, the reduction rate of the changed image Img4is represented by “(360 degrees−B)/360 degrees”.

After the reduction rate is changed, the image display system1is able to display the display image such that the partial image PIXP hardly appears in the output range.

Fourth Embodiment

An image display system1according to a fourth embodiment may be implemented by the image display system1according to the second embodiment. In the following, an example in which the image display system which is essentially the same as the above-described image display system1of the second embodiment is utilized will be described. Hence, a description of a hardware configuration of the image display system1according to the fourth embodiment will be omitted and only the difference between the fourth embodiment and the second embodiment will be described. Namely, an overall process performed by the image display system1according to the fourth embodiment differs from the overall process performed by the image display system1according to the second embodiment.

FIG. 22is a flowchart for explaining an overall process by the image display system1according to the fourth embodiment. The overall process illustrated inFIG. 22differs from the overall process illustrated inFIG. 15in that the overall process illustrated inFIG. 22additionally includes steps S30through S33. In the following, the different points will be explained.

In step S30, the image display system1stores the reduction rate.

In step S31, the image display system1stores the rotational angle.

In step S32, the image display system1rotates the image based on the rotational angle.

After the image is rotated at step S32, in step S33, the image display system1reduces partially or fully the image in the direction toward the position of the screen top and displays the reduced image as the display image.

FIG. 23is a diagram illustrating a processing result of the overall process performed by the image display system1according to the fourth embodiment. As illustrated in the left portion ofFIG. 23, it is assumed that a rotation operation to rotate the first image Img1in the input state or the nonmagnified state (YES in step S05ofFIG. 22) is received from the user. As illustrated in the middle ofFIG. 23, the position of the first image Img1displayed at a highest position (top) PH of the screen2illustrated in the right portion ofFIG. 23is changed according to the rotation operation (step S32ofFIG. 22).

In this example, the image display system1reduces the first image after the rotation in a direction PHD toward the highest position (top) PH (step S33ofFIG. 22).

After the image is reduced in the direction PHD toward the position of the screen top, the image indicated by the predetermined pixels PIX is situated at a position immediately under the screen top PH. Namely, the image indicated by the predetermined pixels PIX hardly appears in the output range and the image display system1is able to display the display image such that the image indicated by the predetermined pixels PIX hardly appears in the output range. Further, the reduced image is generated and the image display system1is able to display a user's desired area of a wide view image.

FIG. 24is a block diagram illustrating a functional configuration of the image display system1according to the second embodiment. As illustrated inFIG. 24, the image display system1may include an input unit1F1, a reduction unit1F5, a nonmagnification unit1F6, and a display unit1F4.

The input unit1F1is configured to receive the image data D1and an operation OPR to change the area of the first image Img1indicated by the image data D1. Note that the input unit1F1may be implemented by the input interface11H3(FIG. 4) or the input device11H4(FIG. 4).

The reduction unit1F5is configured to generate a reduced image Img2by reducing in size partially or fully an image, such as the first image Img1indicated by the image data D1. Note that the reduction unit1F5may be implemented by the CPU11H1(FIG. 4).

The nonmagnification unit1F6is configured to generate, when the reduced image Img2is generated and the operation OPR is received, a nonmagnified image Img3based on the image data D1or by nonmagnification of some or all of a portion of the reduced image Img2. Note that the nonmagnification unit1F6may be implemented by the CPU11H1(FIG. 4).

The display unit1F4is configured to display a display image based on the nonmagnified image Img3. Note that the display unit1F4may be implemented by any of the first projector1A (FIG. 1), the second projector1B (FIG. 1), the third projector1C (FIG. 1), and the fourth projector1D (FIG. 1).

When image data indicating an omnidirectional image covering 360 degrees in the horizontal direction is received by the input unit1F1, the image display system1displays a display image on an object having a hemispherical shape, such as the screen2illustrated inFIG. 1. For example, when the operation OPR such as a rotation operation to change the area which is displayed as a partial image of the display image is received from the user, the image display system1causes the reduction unit1F5to generate the reduced image Img2.

When the reduced image Img2is generated and the rotation operation is received, there may be a case in which an image indicated by predetermined pixels is displayed if the display image is displayed based on the reduced image Img2after the rotation. In such a case, the image display system1causes the nonmagnification unit1F6to generate the nonmagnified image Img3. Then, the image display system1displays the display image based on the nonmagnified image Img3, and the image display system1is able to prevent the image indicated by the predetermined pixels from being displayed.

Hence, the image display system1is able to display, when displaying a wide view image such as an omnidirectional image, a user's desired area of the wide view image.

Note that all or some of the image display processes according to the present disclosure may be implemented by computer programs described in any of the legacy programming languages, such as Assembler, C language, and Java, object-oriented programming languages, or a combination thereof. The programs are computer programs for causing a computer, such as an information processing apparatus or an information processing apparatus included in an image display system, to execute the image display processes.

The programs may be stored in a computer-readable recording medium, such as a read-only memory (ROM) or electrically erasable programmable ROM (EEPROM), and may be distributed with the recording medium. Note that examples of the recording medium include an erasable programmable ROM (EPROM), a flash memory, a flexible disk, an optical disc, a secure digital (SD) card, and a magneto-optic (MO) disc. In addition, the programs may be distributed through an electric telecommunication line.

Further, the image display system according to the present disclosure may include a plurality of information processing apparatuses which are connected with one another via a network, and all or some of the above processes may be performed by the plurality of information processing apparatuses simultaneously, in a distributed manner, or redundantly. In addition, the above processes may be performed by a different device other than the above-described device in the image display system.

The present application is based upon and claims the benefit of priority of Japanese Patent Application No. 2015-160511, filed on Aug. 17, 2015, and Japanese Patent Application No. 2015-160512, filed on Aug. 17, 2015, the contents of which are incorporated herein by reference in their entirety.

The present application additionally includes the following numbered clauses.

1. An image display system which displays a display image and includes at least one display device and at least one information processing apparatus connected to the display device, the information processing apparatus comprising a processor configured to implement

an input unit configured to receive image data and an operation to change an area of an image indicated by the image data, which area is displayed by the display device as a partial image of the display image,

a reduction unit configured to reduce partially or fully the image indicated by the image data and generate a reduced image,

a nonmagnification unit configured to generate, when the reduced image is generated and the operation is received, a nonmagnified image based on the image data or by nonmagnification of some or all of a portion of the reduced image, and

a transmission unit configured to transmit data indicating the nonmagnified image to the display device,

wherein the display device is configured to display the area based on the nonmagnified image.

2. An information processing apparatus connected to at least one display device which displays a display image, the information processing apparatus comprising a processor configured to implement

an input unit configured to receive image data and an operation to change an area of an image indicated by the image data, which area is displayed by the display device as a partial image of the display image,

a reduction unit configured to reduce partially or fully the image indicated by the image data and generate a reduced image,

a nonmagnification unit configured to generate, when the reduced image is generated and the operation is received, a nonmagnified image based on the image data or by nonmagnification of some or all of a portion of the reduced image, and

a transmission unit configured to transmit data indicating the nonmagnified image to the display device.

3. The information processing apparatus according to clause 2, which the image data indicates an image with a field angle of 360 degrees in a horizontal direction.

4. The information processing apparatus according to clause 2 or 3, wherein the reduction and the nonmagnification are performed for the image in a vertical direction.

5. The information processing apparatus according to any of clauses 2 to 4, wherein the operation includes an operation to change the area in a vertical direction.

6. The information processing apparatuses according to any of clauses 2 to 5, wherein, when predetermined pixels are included in the area changed by the operation, the nonmagnification unit is configured to generate the nonmagnified image.

7. The information processing apparatus according to any of clauses 2 to 5, wherein, when predetermined pixels are included in the area changed by the operation, the reduction unit is configured to change a reduction rate at which the reduced image is generated.

8. The information processing apparatus according to any of clauses 2 to 7, wherein the reduction unit is configured to reduce the image toward a highest position of the area changed by the operation.

9. An image display method performed by an image display system which displays a display image and includes at least one display device and at least one information processing apparatus connected to the display device, the image display method comprising

receiving, by the information processing apparatus, image data and an operation to change an area of an image indicated by the image data, which area is displayed by the display device as a partial image of the display image,

reducing partially or fully, by the information processing apparatus, the image indicated by the image data to generate a reduced image,

generating, by the information processing apparatus, when the reduced image is generated and the operation is received, a nonmagnified image based on the image data or by nonmagnification of some or all of a portion of the reduced image,

transmitting, by the information processing apparatus, data indicating the non-magnified image to the display device, and

displaying, by the display device, the area based on the nonmagnified image.

10. A non-transitory computer-readable recording medium storing a program which when executed by a computer causes the computer to execute an image display method, the computer displaying a display image and including at least one display device and at least one information processing apparatus connected to the display device, the image display method comprising

receiving, by the information processing apparatus, image data and an operation to change an area of an image indicated by the image data, which area is displayed by the display device as a partial image of the display image,

reducing partially or fully, by the information processing apparatus, the image indicated by the image data to generate a reduced image,

generating, by the information processing apparatus, when the reduced image is generated and the operation is received, a nonmagnified image based on the image data or by nonmagnification of some or all of a portion of the reduced image,

transmitting, by the information processing apparatus, data indicating the nonmagnified image to the display device, and

displaying, by the display device, the area based on the nonmagnified image.

REFERENCE SIGNS LIST

1image display system

PAR parameters