Display control method and display system

A display control method includes displaying, by a projection device, a first user interface related to an adjustment of a projection image, displaying, by a control device communicating with the projection device, a second user interface including a display object corresponding to the projection image, transmitting, by the projection device, first adjustment information based on a first operation to the first user interface to the control device when the projection device accepts the first operation, adjusting, by the projection device, the projection image based on the first adjustment information, updating, by the control device, the display object based on the first adjustment information, transmitting, by the control device, second adjustment information based on a second operation to the second user interface to the projection device when the control device accepts the second operation, adjusting, by the projection device, the projection image based on the second adjustment information, and updating, by the projection device, the first user interface based on the second adjustment information.

The present application is based on, and claims priority from JP Application Serial Number 2021-190796, filed Nov. 25, 2021, the disclosure of which is hereby incorporated by reference herein in its entirety.

BACKGROUND

1. Technical Field

The present disclosure relates to a display control method and a display system.

2. Related Art

In the past, there has been known a system which has a projection device, and a control device communicating with the projection device, and is which communication is transmitted and received between the projection device and the control device. JP-A-2011-215530 discloses that arbitrary one of a plurality of computers transmits operation information for operating a projection screen to be projected from a projector to the projector. JP-A-2011-215530 also discloses that the projector performs screen control of the projection screen in accordance with the operation information received, and transmits control information representing a control result of the screen control to the plurality of computers.

As such a system as described in JP-A-2011-215530, there is cited a system in which the control device displays an adjusting screen in an adjustment of a projection image. In the system of this kind, there has been required an operation that a user performs an adjustment operation on the adjusting screen, and then confirms an adjustment result of the adjustment operation with the projection image. Therefore, in the system of this kind, transfer of gaze of the user occurs frequently in some cases, and there is a problem that a burden on the user is heavy in the adjustment of the projection image.

SUMMARY

An aspect of the present disclosure is directed to a method of controlling a display system including displaying, by a projection device, a first user interface related to an adjustment of a projection image, displaying, by a control device communicating with the projection device, a second user interface as a user interface which is related to the adjustment of the projection image, and which includes a display object corresponding to the projection image, transmitting, by the projection device, first adjustment information based on a first operation to the first user interface to the control device when the projection device accepts the first operation, adjusting, by the projection device, the projection image based on the first adjustment information, updating, by the control device, the display object based on the first adjustment information, transmitting, by the control device, second adjustment information based on a second operation to the second user interface to the projection device when the control device accepts the second operation, adjusting, by the projection device, the projection image based on the second adjustment information, and updating, by the projection device, the first user interface based on the second adjustment information.

Another aspect of the present disclosure is directed to a display system including a projection device, and a control device configured to communicate with the projection device, wherein the projection device displays a first user interface related to an adjustment of a projection image, the control device displays a second user interface as a user interface which is related to the adjustment of the projection image, and which includes a display object corresponding to the projection image, the projection device transmits first adjustment information based on a first operation to the first user interface to the control device when the projection device accepts the first operation, the projection device adjusts the projection image based on the first adjustment information, the control device updates the display object based on the first adjustment information, the control device transmits second adjustment information based on a second operation to the second user interface to the projection device when the control device accepts the second operation, the projection device adjusts the projection image based on the second adjustment information, and the projection device updates the first user interface based on the second adjustment information.

DESCRIPTION OF AN EXEMPLARY EMBODIMENT

An embodiment will hereinafter be described with reference to the drawings.

FIG.1is a diagram showing an example of a configuration of a display system1000. InFIG.1, there are illustrated an X axis, a Y axis, and a Z axis. The A axis, the Y axis, and the Z axis are perpendicular to each other. The Z axis represents an up-and-down direction and a vertical direction. The X axis and the Y axis are parallel to a horizontal direction. The X axis represents a right-and-left direction. The Y axis represents a front-back direction. A positive direction of the Z axis represents an upward direction. A positive direction of the X axis represents a rightward direction. A positive direction of the Y axis represents a frontward direction. The X axis, the Y axis, and the Z axis shown inFIG.3,FIG.7, andFIG.10are the same as the X axis, the Y-axis, and the Z axis shown inFIG.1.

FIG.1is a diagram showing a configuration of the display system1000. The display system1000according to the present embodiment is provided with a plurality of projectors1arranged side by side. The display system1000performs tiling display of displaying a plurality of projection images G so as to be arranged side by side with the plurality of projectors1.

As shown inFIG.1, the display system100according to the present embodiment is provided with two projectors1consisting of projectors1A,1B. The two projectors1is arranged in a 1×2 matrix. The projector1is an example of a “projection device.”

The number of the projectors1provided to the display system1000is not limited to two, and can be one, or can also be three or more. It is sufficient for an installation on of the plurality of projectors1to be a configuration of being arranged in an N×M matrix. Here, N and M are each an integer equal to or greater than 1.

The projectors1project image light based on image data input from a control device2or an image supply device separated from the control device2to thereby display a projection image G on a screen SC as a projection surface. The screen SC can be a curtain-like screen, or it is also possible to use a wall surface of a building, or a plane of an installed object as the screen SC. The screen SC is not limited to a plane, and can also be a curved surface or a surface having asperity.

A display configuration of the projection image G shown inFIG.1represents a display configuration after an adjustment of the projection image G has appropriately been executed. InFIG.1, the projector1A displays a projection image G1superimposed on an edge of a projection image G2on the screen SC. InFIG.1, the projector1B displays the projection image G2superimposed on an edge of the projection image G1on the screen SC.

The projectors1A,1B are each connected to a network NW. The network NW is a network constituted by communication equipment such as a public network, a dedicated line, or other communication lines, and a specific configuration thereof is not limited. For example, the network NW can be a wide area network, or can also be a local network. The network NW can include at least either one of a wireless communication circuit and a wired communication circuit.

As shown inFIG.1, the display system1000is provided with the control device2. The control device2is connected to the network NW. The control device2shown inFIG.1is a laptop PC (Personal Computer). The control device2is not limited to the laptop PC, and can be equipment such as a desktop PC, a tablet terminal, or a smartphone. The control device2controls the projectors1. When the control device2functions as the image supply device, the control device2divides one frame of the image data into two, and outputs respective parts of the image data thus divided to the projectors1A,1B, respectively.

FIG.2is a block diagram showing a configuration of the projectors1and the control device2.

The projectors1are each provided with a first controller10. The first controller10is provided with a first processor110for executing a program, such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a first memory120, and controls each part of the projector1. In the first controller10, the first processor110retrieves a control program121stored in the first memory120to execute processing. The first processor110retrieves and then executes the control program121to thereby function as a projection controller111, a UI (User Interface) processor112, an adjustment information generator113, a transmitter114, a receiver115, and an acceptor116.

The first memory120is a memory, and stores a program to be executed by the first processor110, data to be processed by the first processor110, and so on. The first memory120has a nonvolatile storage area for storing the program and the data in a nonvolatile manner. It is possible for the first memory120to be provided with a volatile storage area to form a work area for temporarily storing the program to be executed by the first processor110and the data as the processing target.

The first memory120stores setting data122besides the control program121to be executed by the first processor110. The setting data122includes setting values related to an operation of the projector1. As the setting values included in the setting data122, there are cited, for example, a setting value representing a processing content to be executed by an image processor14, a parameter to be used in processing of the image processor14, a parameter representing a lens position of a projection lens164, and a parameter representing a zoom magnification.

In the following description, the parameter representing the lens position of the projection lens164is referred to as a “lens position parameter.” In the following description, the parameter representing the zoom magnification is referred to as a “zoom magnification parameter.”

The projector1is provided with a first interface11, a second interface12, a frame memory13, the image processor14, and an operator15. These constituents are coupled to the first controller10via a bus19so as to be able to perform data communication.

The first interface11provided with communication hardware such as a connector and an interface circuit compliant with a predetermined communication standard. The first interface11transmits and receives the image data, control data, and so on to and from equipment coupled to the projector1in accordance with the control by the first controller and the predetermined communication standard. The first interface11can include an interface capable of transmitting a video and an audio in digital fashion such as HDMI (High-Definition Multimedia Interface), DisplayPort, HDBaseT, USB Type-C, or 3G-SDI (Serial Digital Interface), HDMI is a registered trademark. HDBaseT is a registered trademark. The first interface11can include an interface for data communication such as USB. It is possible for the first interface11to include an interface which is provided with an analog video terminal such as an RCA terminal, a VGA terminal, an S terminal, or a D terminal, and which is capable of transmitting and receiving an analog video signal.

The second interface12is provided with communication hardware such as a connector to be connected to the network NW and an interface circuit. The second interface12communicates with the control device2connected via the network NW in accordance with the predetermined communication standard.

The frame memory13and the image processor14are formed of, for example, an integrated circuit. The integrated circuit includes an LSI, an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), an SoC (System-on-a-Chip), and so on. It is possible for an analog circuit to be included in a part of the configuration of the integrated circuit, or it is also possible to adopt a configuration having the first controller10and the integrated circuit combined with each other.

The frame memory13is provided with a plurality of banks. Each of the banks has a storage capacity sufficient for writing one frame. The frame memory13is formed of, for example, an SDRAM (Synchronous Dynamic Random Access Memory).

The image processor14executes image processing such as a resolution conversion process, a resizing process, a correction of a distortion aberration, a shape correction process, a digital zoom process, and an adjustment of the tint and luminance of the image on the image data developed in the frame memory13. The image processor14executes the processing designated by the first controller10, and executes the processing using a parameter input from the first controller10as needed. It is possible for the image processor14to execute two or more of the processes described above in combination with each other. The image processor14reads out the image data on which the processing has been executed from the frame memory13, and then outputs the image data to a light modulation device drive circuit172.

The operator15is provided with an operation panel151, and a remote control light receiver152.

The operation panel151is disposed in, for example, a chassis of the projector1, and is provided with a variety of switches such as a power switch for switching ON and OFF the power of the projector1. When the switch is operated, the operation panel151outputs a signal corresponding to the switch having been operated to the first controller10.

The remote control light receiver152is provided with a light receiving sensor for receiving an infrared signal transmitted by a remote controller3, a circuit for decoding the infrared signal received by the light receiving sensor, and so on. The remote control light receiver152outputs a signal corresponding to the infrared signal received by the light receiving sensor to the first controller10. The signal which is output to the first controller10by the remote control light receiver152is a signal corresponding to the switch of the remote controller3thus operated.

The projector1is provided with a projection unit16, and a driver17for driving the projection unit16. The projection unit16is provided with a light source161, a light modulation device162, and a projection optical system163. The driver17is provided with a light source drive circuit171, the light modulation device drive circuit172, and a projection optical system drive circuit173.

The light source drive circuit171is coupled to the first controller10via the bus19, and is further coupled to the light source161. The light source drive circuit171puts the light source161on or out in accordance with the control by the first controller10.

The light modulation device drive circuit172is coupled to the first controller10via the bus19, and further the light modulation device162is coupled to the light modulation device drive circuit172. The light modulation device drive circuit172drives the light modulation device162in accordance with the control by the first controller10to draw an image frame by frame on a light modulation element provided to the light modulation device162. To the light modulation device drive circuit172, there is input the image data corresponding to the respective primary colors of R, G, and B from the image processor14. The character R represents red, the character G represents green, and the character B represents blue. The light modulation device drive circuit172converts the image data input thereto into data signals suitable for the operations of liquid crystal panels as the light modulation elements provided to the light modulation device162. The light modulation device drive circuit172applies a voltage to each pixel of each of the liquid crystal panels based on the data signal thus converted, and draws an image on each of the liquid crystal panels.

The light source161is constituted by a lamp such as a halogen lamp, a xenon lamp, or a super-high pressure mercury lamp, or a solid-state light source such as an LED or a laser light source. The source161is put on by the electrical power supplied from the light source drive circuit171, and emits light toward the light modulation device162.

The light modulation device162is provided with, for example, three liquid crystal panels corresponding respectively to the three primary colors of RGB. The light emitted from the light source161is separated into colored light beams of three colors of B, G, and B, and the colored light beams respectively enter the corresponding liquid crystal panels. The three liquid crystal panels are each a transmissive liquid crystal panel, and each modulate the light beam transmitted through the liquid crystal panel to generate an image light beam. The image light beams, which have been modulated while passing through the respective liquid crystal panels, are combined by a combining optical system such as a cross dichroic prism, and are then emitted to the projection optical system163.

Although in the present embodiment, there is illustrated when the light modulation device162is provided with the transmissive liquid crystal panels as the light modulation elements, the light modulation elements can be reflective liquid crystal panels, or can also be digital mirror devices (digital micromirror devices).

The projection optical system163is provided with the projection lens164for focusing the image light beam having been modulated by the light modulation device162on the screen SC. The projection lens164in the present embodiment is a zoom lens for projecting the image light beam modulated by the light modulation device162at a desired magnification ratio. The projection optical system163can also be provided with a zoom mechanism for magnifying or demagnifying the projection image G to be projected on the screen SC, a focus adjustment mechanism for performing an adjustment of the focus, and so on.

To the projection optical system163, there is coupled the projection optical system drive circuit173. The projection optical system drive circuit173is coupled to the bus19. The projection optical system drive circuit173performs a lens shift adjustment of moving the projection lens164in a plane perpendicular to an optical axis of the projection lens161to move the projection image G to be projected on the screen SC in the X-axis direction and the Z-axis direction in accordance with the control by the first controller10.

As described above, the first processor110functions as the projection controller111, the UI processor112, the adjustment information generator113, the transmitter114, the receiver115, and the acceptor116.

The projection controller111controls the image processor14, the driver17, and so on to display the projection image G on the screen SC.

Specifically, the projection controller111controls the image processor14to make the image processor14process the image data developed in the frame memory13. On this occasion, the projection controller111retrieves the parameter which is necessary for the image processor14to perform the processing from the first memory120, and then outputs the parameter to the image processor14.

The projection controller111controls the light source drive circuit171and the light modulation device drive circuit172to make the light source drive circuit171out the light source161on, make the light modulation device drive circuit172drive the light modulation device162, and make the projection unit16project the projection image G. The projection controller111controls the projection optical system163to start up a motor to adjust the zoom and the focus of the projection optical system163. The projection controller111retrieves the lens position parameter from the setting data122, and controls the projection optical system drive circuit173based on the lens position parameter thus retrieved to thereby move the projection lens164to the lens position represented by the lens position parameter. The lens position parameter includes a parameter representing a lens position of the projection lens164in the up-and-down direction, and a parameter representing a lens position of the projection lens164in the horizontal direction.

The UI processor112generates the image data of a first UI1121. The first UI1121is a UI related to the adjustment of the projection image G. When the UI processor112generates the image data of the first UI1121, the UI processor112develops the image data of the first UI1121thus generated in the frame memory13. It is possible for the UI processor112to superimpose the image data of the first UI1121on the image data having already been developed in the frame memory13, or to overwrite the image data having already been developed in the frame memory13with the image data of the first UI1121. The UI processor112updates the display content of the first UI1121.

FIG.3is a diagram showing an example of the first UI1121to be projected on the screen SC.

The first UI1121shown inFIG.3is the first UI1121for a lens shift adjustment. The first UI1121for the lens shift adjustment has a first display object OB1, and a second display object OB2to be superimposed on the first display object OB1.

The second display object OB2is an image representing a positional relationship between a lens shift available area and the projection image G. The lens shift available area means an area in which it is possible to move the projection image G by the lens shift adjustment. The second display object OB2includes a third display object OB3, and a fourth display object OB4to be superimposed on the third display object OB3. The third display object OB3is an image representing the lens shift available area. In the lens shift available area represented by the third display object OB3, there are disposed a scale extending upward and downward, and a scale extending rightward and leftward. The fourth display object OB4is an image representing a size of the projection image G, and a position of the projection image G in the lens shift available area.

The first display object OB1is an image obtained by magnifying the fourth display object OB4in the state of being superimposed on the third display object OB3. The size of the first display object OB1to be projected on the screen SC coincides with the size of a projection area where the projection image G is projected.

When the projector1starts the display of the first UI1121, the UI processor obtains the lens position parameter and the zoom magnification parameter from the setting data122. Subsequently, the UI processor112recognizes the size of the projection image G to the lens shift available area and the position of the projection image G in the lens shift available area based on these parameters thus obtained, and then generates the second display object OB2based on the recognition result. The UI processor112generates the second display object OB2, and then, generates the first display object OB1obtained by magnifying the fourth display object OB4represented by the second display object OB2thus generated. The UI processor112generates the first display object OB1and the second display, object OB2, and then, generates the first UI1121in which the second display object OB2is superimposed on an upper left portion of the first display object OB1. Then, the UI processor112develops the image data of the first UI1121thus generated in the frame memory13.

Going back to the description of the functional units of the first processor110, the adjustment information generator113generates first adjustment information. The adjustment information generator113outputs the first adjustment information thus generated to the transmitter114. The first adjustment information is information representing the adjustment of the projection image G by a first operation accepted by the acceptor116. The first operation is an operation to the first UI1121, and is an operation of adjusting the projection image G. The first adjustment information includes information representing a direction in which the projection image G has moved, and information representing a displacement of the projection image G when, for example, the adjustment of the projection image G is the lens shift adjustment. The first adjustment information is information representing a zoom magnification having been adjusted when, for example, the adjustment of the projection image G is the adjustment of the zoom magnification.

The transmitter114transmits the first adjustment information to the control device2via the second interface12. An address of the control device2is stored in the first memory120in advance.

The receiver115receives second adjustment information from the control device2via the second interface12. The second adjustment information will be described later.

The acceptor116accepts an operation of the user to the projector1. The acceptor116accepts an operation to a variety of switches provided to the chassis of the projector1via the operation panel151. The acceptor116accepts an operation to a variety of switches provided to the remote controller3via the remote control light receiver152. The acceptor116in the present embodiment accepts the first operation via the operation panel151or the remote control light receiver152.

Then, a configuration of the control device2will be described. The control device2is provided with a second controller20, a communicator21, an input unit22, and a display unit23.

The second controller20is provided with a second processor210for executing a program, such as a CPU or an MPU, and a second memory220. In the second controller20, the second processor210retrieves and then executes a control program221stored in the second memory220to thereby control the constituents of the control device2. The second processor210retrieves and then executes an adjustment app222stored by the second memory220to thereby function as an app executor211.

The second memory220stores a program to be executed by the second processor210, and data to be processed by the second processor210. The second memory220stores the control program221and the adjustment app222to be executed by the second processor210, and other variety of types of data. The second memory220has a nonvolatile storage area. The second memory220can be provided with a volatile storage area to configure a work area for the second processor210.

The adjustment app222is an application program related to the adjustment of the projection image G.

The communicator21is a communication interface provided with a communication circuit, a connector, and so on, and communicates with the projector1connected to the network NW in accordance with a predetermined communication standard. The communication standard of the communicator21can be a wireless communication standard, or can also be a wired communication standard.

The input unit22has an input device such as an operation switch provided to the control device2, a panel having a touch input function, a mouse, or a keyboard, detects an operation by the user to the input device, and then outputs the detection result to the second controller20. The second controller20executes processing corresponding to the operation to the input device based on the input from the input unit22.

The display unit23is provided with a display, and displays information on the display in accordance with the control by the second controller20.

As described above, the second processor210functions as the app executor211. The app executor211communicates with the projector1via the communicator21. The app executor211displays a second UI2211. The app executor211updates the display content of the second UI2211.

FIG.4is a diagram showing an example of the second UI2211. The second UI2211shown inFIG.4is the second UI2211for the lens shift adjustment. The second UI2211for the lens shift adjustment has a fifth display object OB5. The fifth display object OB5is an example of a “display object.”

The fifth display object OB5is an image representing a positional relationship between the lens shift available area and the projection image G. The fifth display object OB5includes a sixth display object OB6, and a seventh display object OB7to be superimposed on the sixth display object OB6. The sixth display object OB6is an image representing the lens shift available area. In the lens shift available area represented by the sixth display object OB6, there can be set the scales similarly to the third display object OB3. The seventh display object OB7is an image representing the size of the projection image G, and the position of the projection image G in the lens shift available area.

When the app executer211starts the display of the second UI2211, the app executer211obtains the lens position parameter and the zoom magnification parameter from the projector1. Subsequently, the app executer211recognizes the size of the projection image G and the position of the projection image G in the lens shift available area based on these parameters thus obtained, and then generates the fifth display object OB5based on the recognition result.

The second UI2211has buttons B1, B2, B3, and B4. The buttons B1, B2, B3, and B4are software buttons. The button B1is a button for moving the projection image G upward. The button B2is a button for moving the projection image G rightward. The button B3is a button for moving the projection image G downward. The button B4is a button for moving the projection image G leftward.

The app executer211generates the second adjustment information, and then transmits the second adjustment information thus generated to the projector1. The second adjustment information is information representing the adjustment of the projection image G by a second operation accepted by the app executer211. The second operation is an operation to the second UI2211, and is an operation of adjusting the projection image G. The app executer211accepts the second operation via at least one of the buttons B1, B2, B3, and B4. The second adjustment information includes information representing a direction in which the projection image G is moved, and information representing a displacement of the projection image G when, for example, the adjustment of the projection image G is the lens shift adjustment. The second adjustment information is information representing a zoom magnification to be adjusted when, for example, the adjustment of the projection image G is the adjustment of the zoom magnification.

Then, an operation of the display system1000will be described.FIG.5is a flowchart showing the operation of the display system1000. InFIG.5, a flowchart FA represents the operation of the control device2, and a flowchart FB represents the operation of the projector1.

In the operations shown inFIG.5, the lens shift adjustment is illustrated as the adjustment of the projection image G.

As shown in the flowchart FA, the app executer211determines (step SA1) whether or not an adjustment start instruction of the lens shift adjustment has been accepted from the user.

When the app executer211has determined that the adjustment start instruction of the lens shift adjustment has not been accepted from the user (NO in the step SA1), the app executer211perform the determination in the step SA1once again.

In contrast, when the app executer211has determined that the adjustment start instruction of the lens shift adjustment has been accepted from the user (YES in the step SA1), the app executer211transmits (step SA2) adjustment start information representing that the adjustment start instruction of the lens shift adjustment has occurred to the projector1as the adjustment target.

As shown in the flowchart FB, the receiver115receives (step SB1) the adjustment start information.

Then, the transmitter114transmits (step SB3) the two types of parameters obtained in the step SB2to the control device2.

Then, the projection controller111displays (step SB5) the first UI1121generated in the step SB4on the screen SC.

As shown in the flowchart FA, the app executer211receives (step SA3) the two types of parameters from the projector1.

Then, the app executer211displays (step SA5) the second UI2211generated in the step SA4on the screen SC.

Then, an operation of the display system1000when the adjustment of the projection image G is performed using the first UI1121will be described.

FIG.6is a flowchart showing the operation of the display system1000. InFIG.6, a flowchart FC represents the operation of the control device2, and a flowchart FD represents the operation of the projector In the operations shown inFIG.6, the projector1currently displays the first UI1121, and the control device2currently displays the second UI2211. In the operations shown inFIG.6, the lens shift adjustment is illustrated as the adjustment of the projection image G.

As shown in the flowchart FD, the acceptor116determines (step SD1) whether or not the first operation has been received. In the operations shown inFIG.6, the first operation is an operation to the first UI1121for the lens shift adjustment, and is an operation of moving the projection image G.

When the acceptor116has determined that the first operation has not been accepted (NO in the step SD1), the acceptor116performs the determination in the step SD1once again.

When the acceptor116has determined that the first operation has been accepted (YES in the step SD1), the projection controller111controls the projection optical system drive, circuit173to thereby adjust (step SD2) the position of the projection image G in accordance with the first operation thus accepted.

Then, the UI processor112updates (step SD3) the first UI1121currently displayed by the projector1with the first UI1121corresponding to the adjustment performed in the step SD2.

FIG.7is a diagram showing an example of the first UI1121to be projected on the screen SC.FIG.7shows when the first operation is an operation of moving the projection image G rightward as much as a first distance. In the case ofFIG.7, the UI processor112updates the second display object OB2currently displayed with the second display object OB2described below. That is, the UI processor112performs the update with the second display object OB2obtained by moving the fourth display object OB4rightward as much as a distance corresponding to the first distance in the lens shift available area represented by the third display object OB3. In the case ofFIG.7, the UI processor112updates the first display object OB1currently displayed with the first display object OB1obtained by magnifying the fourth display object OB4having been moved rightward.

Then, the adjustment information generator113generates (step SD4) the first adjustment information. In the case ofFIG.7, the adjustment information generator113generates the first adjustment information representing that the moving direction of the projection image G is the rightward direction, and that the displacement of the projection image G is the first distance.

Then, the transmitter114transmits (step SD5) the first adjustment information generated in the step SD4to the control device2.

As shown in the flowchart FC, the app executer211receives (step SC1) the first adjustment information from the projector1.

Then, the app executer211updates (step SC2) the fifth display object OB5of the second UI2211based on the first adjustment information received in the step SC1.

FIG.8is a diagram showing an example of the second UI2211.

InFIG.8, there is illustrated when the first adjustment information thus received represents that the moving direction of the projection image G is the rightward direction, and that the displacement of the projection image G is the first distance. As shown inFIG.8, in the step SC2, the app executer211updates the fifth display object OB5currently displayed with the fifth display object OB5described below. That is, the app executer211performs the update with the fifth display object OB5obtained by moving the seventh display object OB7rightward as much as a distance corresponding to the first distance in the lens shift available area represented by the sixth display object OB6.

Then, an operation of the display system1000when the adjustment of the projection image G has been performed in the second UI2211will be described.

FIG.9is a flowchart showing the operation of the display system1000. InFIG.9, a flowchart FE represents the operation of the control device2, and a flowchart FF represents the operation of the projector1. In the operations shown inFIG.9, the projector1currently displays the first UI1121, and the control device2currently displays the second UI2211.

As shown in the flowchart FE, the app executer211determines (step SE1) whether or not the second operation has been received. The second operation is an operation to the second UI2211, and is an operation of adjusting the projection image G. In the operations shown inFIG.9, the second operation is an operation to the second UI2211for the lens shift adjustment.

When the app executer211has determined that the second operation has not been accepted (NO in the step SE1), the app executer211performs the determination in the step SE1once again.

When the app executer211has determined that the second operation has been accepted (YES in the step SE1), the app executer211updates (step SE2) the fifth display object OB5of the second UI2211.

The step SE2will be described invokingFIG.8.

When the second operation is an operation of moving the projection image G rightward as much as a second distance, the app executer211updates the fifth display object OB5as shown inFIG.8. That is, the app executer211updates the fifth display object OB5currently displayed with the fifth display object OB5obtained by moving the seventh display object OB7rightward as much as a distance corresponding to the second distance in the lens shift available area represented by the sixth display object OB6.

Then, the app executer211generates (step SE3) the second adjustment information. For example, when the second operation having been accepted is the operation of moving the projection image G rightward as much as the second distance, the app executer211generates the second adjustment information representing that the moving direction of the projection image G is the rightward direction, and that the displacement of the projection image G is the second distance.

Then, the app executer211transmits (step SE4) the second adjustment information generated in the step SE3to the projector1.

As shown in the flowchart FF, the receiver115receives (step SF1) the second adjustment information from the control device2.

Then, the UI processor112updates (step SF2) the first UI1121based on the second adjustment information received in the step SF1.

The step SF2will be described invokingFIG.7.

When the second adjustment information having been received represents that the projection image G is moved rightward as much as the second distance, the UI processor112updates the first UI1121in the step SF2as shown inFIG.7. That is, the UI processor112performs the update with the second display object OB2obtained by moving the fourth display object OB4rightward as much as a distance corresponding to the second distance in the lens shift available area represented by the third display object OB3. The UI processor112updates the first display object OB1with the first display object OB1obtained by magnifying the fourth display object OB4, which has been moved rightward as much as a distance corresponding to the second distance, up to the projection area.

In the description with reference toFIG.5,FIG.6,FIG.7,FIG.8, andFIG.9, there is illustrated when the adjustment of the projection image G is the lens shift adjustment. However, the adjustment of the projection image G is not limited to the lens shift adjustment, and can also be a zoom adjustment, an adjustment of a geometric correction, or the like. In the adjustment other than the lens shift adjustment, there are displayed the first UI1121and the second UI2211corresponding to the adjustment other than the lens shift adjustment.

FIG.10is a diagram showing an example of the first UI1121related to the zoom adjustment. As is obvious from a comparison betweenFIG.3andFIG.10, in the first UI1121related to the zoom adjustment, the second display object OB2further includes an eighth display object OB8. The eighth display object OB8is an image representing the size of the projection image G when the zoom magnification is the lowest. The center of the eighth display object OB8coincides with the center of the fourth display object OB4. Therefore, when, for example, the fourth display object OB4has moved due to the lens shift adjustment, the eighth display object OB8moves so that the center thereof coincides with the center of the fourth display object OB4.

FIG.11is a diagram showing an example of the second UI2211related to the zoom adjustment.

As is obvious from a comparison betweenFIG.4andFIG.11, in the second UI2211related to the zoom adjustment, the fifth display object OB5further includes a ninth display object OB9. The ninth display object OB9is an image representing the size of the projection image G when the zoom magnification is the lowest. The center of the ninth display object OB9coincides with the center of the seventh display object OB7. Therefore, when, for example, the seventh display object OB7has moved due to the lens shift adjustment, the ninth display object OB9moves so that the center thereof coincides with the center of the seventh display object OB7.

As described hereinabove, the method of controlling the display system1000includes displaying, by the projector1, the first UI1121related to the adjustment of the projection image G, displaying, by the control device2communicating with the projector1, the second UI2211as the UI which is related to the adjustment of the projection image G, and which includes the fifth display object OB5corresponding to the projection image G, transmitting, by the projector1, the first adjustment information based on the first operation to the control device2when the projector1accepts the first operation to the first UI1121, adjusting, by the projector1, the projection image G based on the first adjustment information, updating, by the control device2, the fifth display object OB5based on the first adjustment information, transmitting, by the control device2, the second adjustment information based on the second operation to the projector1when the control device2accepts the second operation to the second UI2211, adjusting, by the projector1, the projection image G based on the second adjustment information, and updating, by the projector1, the first UI1121based on the second adjustment information.

According to the above, the projector1and the control device2display the UI related to the adjustment of the projection image G, the fifth display object OB5is updated in tandem with the first operation, and the projection image G is adjusted and at the same time the first UI1121is updated in tandem with the second operation. Therefore, it becomes possible to perform the adjustment of the projection image G just by looking at either one of the projection image G of the projector1and the display screen of the control device2. Therefore, it is possible to reduce the number of times the projection image G of the projector1and the display screen of the control device2are compared by eyes with each other in the adjustment of the projection image G, and thus, it is possible to reduce the burden on the user in the adjustment of the projection image G. Further, since it is possible to reduce the burden on the user in the adjustment of the projection image G, it is possible to increase the adjustment operation efficiency of the projection image G, and thus, it is possible to achieve reduction in time for adjusting the projection image G.

The projector1displays the first UI1121when the control device2accepts the adjustment start instruction of the projection image G, and the control device2displays the second UI2211when the control device2accepts the adjustment start instruction of the projection image G.

According to the above, the projector1functions as starting point to start the adjustment of the projection image G.

The control device2displays the second UI2211when the projector1accepts the adjustment start instruction of the projection image G, and the projector1displays the first UI1121when the projector1accepts the adjustment start instruction of the projection image G.

According to the above, the control device2functions as a starting point to start the adjustment of the projection image G.

The method of controlling the display system1000includes updating, by the projector1, the first UI1121based on the first operation when the projector1accepts the first operation, and updating, by the control device2, the fifth display object OB5based on the second operation when the control device2accepts the second operation.

According to the above, the first UI1121is updated in tandem with the first operation, and the fifth display object OB5of the second UI2211is updated in tandem with the second operation. Therefore, it is possible to reduce the number of times the projection image G of the projector1and the display screen of the control device2are compared by eyes with each other in the adjustment of the projection image G, and thus, it is possible to reduce the burden on the user in the adjustment of the projection image G.

The adjustment of the projection image G is the lens shift adjustment, the first UI1121represents the positional relationship between the projection image G and the lens shift available area in which it is possible to move the projection image G with the lens shift adjustment, and the fifth display object OB5represents a positional relationship between the lens shift available area and the projection image G.

According to the above, it is possible to reduce the burden on the user in the lens shift adjustment.

The display system1000includes the projector1and the control device2communicating with the projector1. The projector1displays the first UI1121related to the adjustment of the projection image G. The control device2displays the second UI2211as the UI which is related to the adjustment of the projection image1, and which includes the fifth display object OB5corresponding to the projection image G. The projector1transmits the first adjustment information based on the first operation to the control device2when the projector1accepts the first operation to the first UI1121. The projector1adjusts the projection image G based on the first adjustment information. The control device2updates the fifth display object OB5based on the first adjustment information. The control device2transmits the second adjustment information based on the second operation to the projector1when the control device2accepts the second operation to the second UI2211. The projector1adjusts the projection image G based on the second adjustment information. The projector1updates the first UI1121based on the second adjustment information.

According to the above, substantially the same advantages as the advantages of the method of controlling the display system1000described above are exerted.

The embodiment described above is a preferred aspect of an implementation of the present disclosure. It should be noted that the present embodiment is not a limitation, and the present disclosure can be implemented in a variety of modified aspects within the scope or the spirit of the present disclosure.

In the embodiment described above, there is illustrated when the plurality of projectors1performs tiling display, but the display aspect performed by the plurality of projectors1is not limited to the tiling display, and it is possible to perform, for example, stacking display of stacking a plurality of projection images G to display the projection images G high in luminance.

It is possible to realize the functions of the first processor110and the second processor210with a plurality of processors, or a semiconductor chip.

The functional units shown inFIG.2are for showing a functional configuration, and do not limit a specific implementation configuration. For example, in the projector1and the control device2, it is not necessarily required to install the hardware corresponding individually to each of the functional units, but it is obviously possible to adopt a configuration of realizing the functions of the plurality of functional units by a single processor executing a program. A part of the function realized by the software in the embodiment described above can also be realized by hardware, or a part of the function realized by the hardware can also be realized by software. Besides the above, the specific detailed configuration of each of other constituents of the projector1and the control device2can arbitrarily be modified within the scope or the spirit of the present disclosure.

For example, the unit steps of the operations shown inFIG.5,FIG.6, andFIG.9are obtained by dividing the operations in accordance with principal processing contents in order to make easy to understand the operation of the display system1000, and the present disclosure is not limited by the way of the division or the name of the processing unit. It is possible to divide the operations into a larger number of unit steps in accordance with the processing contents. It is also possible to divide the operations so that each of the unit steps includes a larger amount of processing. The order of the steps can arbitrarily be exchanged within a range in which no problem is posed in the scope or the spirit of the present disclosure.