Patent Description:
Conventionally technologies for displaying an image to the outside of a vehicle have been disclosed.

Patent Document <NUM> discloses: "Cameras are mounted on the outside of the vehicle, corresponding to the positions of the display screens. A (plurality of) sensor(s) is oriented facing the driver of the vehicle to sense the positions of the eyes of the driver. An ECU for a display system analyzes the positions of the eyes of the driver to calculate a gaze line. An image from a camera is displayed on a display screen corresponding to the gaze line of the driver. The result is that the display system provides, to the driver, an image that appears as if the vehicle body were not there, without the vehicle obstructing the view by the driver.

<CIT> relates to a driving support unit captures an image of a driver's blind spot due to presence of a pillar of a vehicle includes at least first and second cameras which are mounted on the vehicle, a display device for displaying the image on the interior surface of the pillar and a control section for detecting position of the head of the driver, calculating a blind spot angle due to the presence of the pillar in accordance with the position of the head of the driver, and for selecting, based on the calculated angle, one of the cameras to capture the image. The first camera captures an image the major portion of which is an area to the side of the vehicle, and the second camera captures an image the major portion of which is an area to the front of the vehicle.

<CIT> a system where an image around a vehicle matching the intent of a driver is automatically displayed. An infrared camera picks up an image of the face of a driver. A visual line direction and a face direction are detected from the face image of the driver. Based on the visual line direction of the driver and the face direction thereof, a direction in which the driver gazes is detected. When the direction in which the driver gazes is included in image pickup ranges of CCD cameras, an image around a vehicle picked up by any one of the CCD cameras is automatically displayed on a monitor.

<CIT> relates to a system and method for image display on vehicle interior component is disclosed. The system and method is configured to display objects obstructed to the field of view of the operator of the vehicle on a display panel; the objects may be visible to the operator viewing the display panel in a consistent scale/form with objects visible to the operator through the windshield and side windows of the vehicle.

In the display system disclosed in Patent Document <NUM>, an image that appears as if the vehicle body were not there is displayed on a display. Given this, when the position of the eye of the driver moves in the vertical direction, a region of the image that is displayed on the display moves in the vertical direction so as to correspond with the position of the eye of the driver. However, in this case, there is the possibility that the driver will feel uncomfortable with the image that is displayed on the display.

The object of the present invention is to provide a display controlling device and display controlling method able to prevent the driver from feeling uncomfortable with the image that is displayed on the display.

In order to achieve the object according to above, a display controlling device according to the present application is, for example, a display controlling device for displaying, on a display that is mounted on the interior of a vehicle, an image of outside of the vehicle so as to appear as if looking through the vehicle body of the vehicle, comprising: a position detecting unit for detecting a position of the head of the driver and a position of an eye of the driver; a region adjusting unit for adjusting a position of a region, of the image of the outside of the vehicle, displayed on the display, depending on a detection result by the position detecting unit; and a display controlling unit for displaying, on the display, an image corresponding to the region at the position adjusted by the region adjusting unit, wherein: when the position of the head has changed so as to move in both the vertical direction and the crosswise direction of the vehicle, the region adjusting unit prevents adjustment of the position of the region to a position corresponding to the change, in the vertical direction, of the position of the eye, and adjusts the position of the region to a position corresponding to the change, in the crosswise direction, of the position of the eye.

The ability to prevent the driver from feeling discomfort with the image that is displayed on the display when the actual position of the eye changes in the vertical direction, even if the driver did not intend to move in the vertical direction.

Embodiments according to the present invention will be explained below in reference to the drawings.

The structure of an onboard system <NUM> that includes the display controlling device <NUM> according to the present embodiment will be explained first in reference to <FIG> is a diagram showing an example of a structure for an onboard system <NUM> that includes a display controlling device <NUM> according to the present embodiment.

As illustrated in <FIG>, the onboard system <NUM> comprises an imaging unit <NUM>, a display <NUM>, and a display controlling device <NUM>.

The imaging unit <NUM> comprises an outside imaging camera <NUM> and a driver imaging camera <NUM>.

The outside imaging camera <NUM> captures an image of outside of the vehicle <NUM>, to produce an outside image PQ. The outside imaging camera <NUM> outputs the outside image PQ to the display controlling device <NUM>. The driver imaging camera <NUM> captures an image of the driver to generate a driver image PD. The driver imaging camera <NUM> outputs the driver image PD to the display controlling device <NUM>.

Each of these cameras comprises: an image sensor such as a CCD (Charge-Coupled Device), CMOS (Complementary Metal-Oxide-Semiconductor), or the like, with a data processing circuit for generating a captured image from the image sensors, and a data transmitting circuit for outputting the captured image to the display controlling device <NUM>.

A display <NUM> is mounted in the interior of the vehicle <NUM>. For example, The display <NUM> comprises an LCD (Liquid Crystal Display), or the like. The display <NUM> displays an image that is a part of the outside image PQ in accordance with an instruction from the display controlling device <NUM>. The display <NUM> displays an image PE, of the outside image PQ, corresponding to a region R of a position adjusted by the display controlling device <NUM>. The region R will be explained in reference to <FIG>.

The display controlling device <NUM> controls the respective operations of the imaging unit <NUM> and the display <NUM>. The display controlling device <NUM> displays the image PE of the region R on the display <NUM>. The image PE of the region R is a part of the outside image PQ so as to appear as if one is looking through the vehicle body <NUM> of the vehicle <NUM>.

The display controlling device <NUM> acquires the outside image PQ and the driver image PD from the imaging unit <NUM>.

The display controlling device <NUM> displays, on the display <NUM>, the image PE of the region R of a part of the outside image PQ.

After explaining <FIG> for the display controlling device <NUM>, we will return again to explaining <FIG>.

The layout of the onboard system <NUM> according to the present embodiment will be explained next in reference to <FIG> is a plan view showing an example of the layout of the onboard system <NUM> according to the present embodiment.

An X axis, a Y axis, and a Z axis are shown in <FIG>. The X axis, the Y axis, and the Z axis are mutually perpendicular. The X axis is parallel to the crosswise direction of the vehicle <NUM>, the Y axis is parallel to the front/rear direction of the vehicle <NUM>, and the Z axis is parallel to the vertical direction of the vehicle <NUM>. The positive direction of the X axis is the direction to the right of the vehicle <NUM>, the positive direction of the Y axis is the direction to the front of the vehicle <NUM>, and the positive direction of the Z axis is the direction to the top of the vehicle <NUM>.

As illustrated in <FIG>, the vehicle <NUM> includes the aforementioned onboard system <NUM> and a vehicle body <NUM>. The onboard system <NUM> is installed in the vehicle body <NUM> of the vehicle <NUM>.

The vehicle body <NUM> is equipped with A-pillars <NUM>. The A-pillars <NUM> include a right A-pillar 21R and a left A-pillar <NUM>.

The outside imaging cameras <NUM> include a right outside imaging camera 111R and a left outside imaging camera <NUM>. For example, the right outside imaging camera 111R is mounted on the outer surface of the right A-pillar 21R. For example, The left outside imaging camera <NUM> is mounted on the outer surface of the left A-pillar <NUM>.

For example, the driver imaging camera <NUM> is mounted in the vicinity of the rear-view mirror.

The display <NUM> includes a right display 12R and a left display <NUM>. The right display 12R is mounted on the inner surface of the right A-pillar 21R. The left display <NUM> is mounted on the inner surface of the left display <NUM>.

For example the display controlling device <NUM> is mounted in the dashboard.

An imaging direction V1 indicates an imaging direction of the right outside imaging camera 111R. For example, the imaging direction V1 matches the direction from the position of an eye DE (not shown) of the driver toward the right outside imaging camera 111R. The imaging range θ1 indicates the imaging range of the right outside imaging camera 111R.

A U axis, a V axis, and a Z axis are shown in <FIG>. The U axis, V axis, and Z axis specify a position in the outside image PQ imaged by the right outside imaging camera 111R. The Z axis is parallel to the vertical direction of the vehicle body <NUM>. The V axis is, for example, parallel to the imaging direction V1, and the U axis is the direction that is perpendicular to the Z axis and the V axis. The positive direction of the U axis is the direction to the right of the gaze line of the driver, and the positive direction of the V axis is the direction to the back of the gaze line of the driver. Note that insofar as the V axis is not greatly divergent from the gaze line of the driver, it need not necessarily be the imaging direction V1. For example, the V axis may be the direction directly toward the surface, in the display <NUM>, wherein the image is displayed, or may be the direction that is parallel to a straight line between the position of the eye DE of the driver and the center of the surface, in the display <NUM>, wherein the image is displayed.

An imaging direction V2 indicates an imaging direction of the left outside imaging camera <NUM>. The imaging direction V2 coincides with, for example, the direction from the position of an eye DE (not shown) of the driver toward the left outside imaging camera <NUM>. The imaging range θ2 indicates the imaging range of the left outside imaging camera <NUM>. The V axis, U axis, and Z axis may be provided corresponding to the imaging direction V2.

The head DH of the driver is shown in <FIG>. The imaging direction W indicates the imaging direction of the driver imaging camera <NUM>. The imaging range φ indicates the imaging range of the driver imaging camera <NUM>. The imaging range φ includes the head DH of the driver.

Returning to <FIG>, the structure of the display controlling device <NUM> according to the present embodiment will be explained next.

The display controlling device <NUM> comprises a processor 13A and a memory 13B. The processor 13A is structured from a CPU (Central Processing Unit), an MPU (MicroProcessing Unit), or the like. The memory 13B is structured from a ROM (Read-Only Memory), a RAM (Random Access Memory), or the like. Moreover, the memory 13B may comprise a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like.

The display controlling device <NUM> comprises, in addition to these devices: an interface circuit for connecting to sensors, peripheral devices, and the like; and an onboard network communication circuit for communicating with other onboard systems through an onboard network. In the display controlling device <NUM>, a variety functional structures is achieved through a processor 13A executing a control program <NUM> that is stored in the memory 13B.

For example, the display controlling device <NUM> is structured from, an ECU (Electronic Control Unit).

For example, the display controlling device <NUM> may be structured through an integrated circuit. Integrated circuits include LSIs, ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). PLDs include, for example, FPGAs (Field-Programmable Gate Arrays). Moreover, analog circuits may also be included in a portion of the structure of the integrated circuit, and a processor and an integrated circuit may be combined. The combination of a processor and an integrated circuit is called a microcontroller (MCU), an SoC (system-on-a-chip), a system LSI, a chipset, or the like.

The display controlling device <NUM> comprises a position detecting unit <NUM>, a region adjusting unit <NUM>, and a display controlling unit <NUM>. Specifically, the processor 13A, through executing a control program <NUM> that is stored in the memory 13B, functions as the position detecting unit <NUM>, the region adjusting unit <NUM>, and the display controlling unit <NUM>.

The position detecting unit <NUM> acquires the driver image PD from the driver imaging camera <NUM>. Moreover, the position detecting unit <NUM> detects the position of the head DH of the driver and the position of the eye DE of the driver based on the driver image PD. For example, the position detecting unit <NUM> executes image processing on the driver image PD to detect the position of the head DH of the driver and the position of the eye DE of the driver.

In the present embodiment, a case will be explained wherein the position detecting unit <NUM> detects the position of the dominant eye of the driver as the position of the eye DE of the driver. The explanation will be for a case wherein the right eye of the driver is set as the dominant eye of the driver.

The region adjusting unit <NUM> acquires the outside image PQ from the outside imaging camera <NUM>. The region adjusting unit <NUM> adjusts the position of the region R, from the outside image PQ that has been captured by the outside imaging camera <NUM>, to be displayed on the display <NUM> in accordance with the detection result by the position detecting unit <NUM>.

For example, when the position of the head DH changes so as to move in both the vertical direction of the vehicle <NUM> and the crosswise direction of the vehicle <NUM> , the region adjusting portionunit <NUM> executes the following process. The position of the head DH also changes so as to move in both the vertical direction of the vehicle <NUM> and the front/rear direction of the vehicle <NUM>, the region adjusting unit <NUM> executes the following process. Specifically, the region adjusting unit <NUM> adjusts the position of the region R to a position corresponding to the change of the position of the eye DE in the crosswise direction and/or the front/rear direction, while preventing an adjustment of the position of the region R to a position corresponding to the change in the vertical direction in the position of the eye DE. In other words, the region adjusting unit <NUM> moves the position of the region R in the crosswise direction and/or the front/rear direction, without moving in the vertical direction.

Note that the crosswise direction corresponds to the X-axial direction in <FIG>, the front/rear direction corresponds to the Y-axial direction in <FIG>, and the vertical direction corresponds to the Z-axial direction in <FIG>.

For example, when the position of the head DH has changed so as to move in both the vertical direction and the crosswise direction, the region adjusting unit <NUM> executes the following process. Specifically, the region adjusting unit <NUM> adjusts the position of the region R to a position corresponding to the change of the position of the eye DE in the crosswise direction while preventing an adjustment of the position of the region R to a position corresponding to the change of the position of the eye DE in the vertical direction.

This case will be explained further in reference to <FIG>.

Moreover, when the position of the head DH has changed so as to move in both the vertical direction and the front/rear direction, the region adjusting unit <NUM> executes the following process. Specifically, the region adjusting unit <NUM> adjusts the position of the region R to a position corresponding to the change of the position of the eye DE in the front/back direction while preventing an adjustment of the position of the region R to a position corresponding to the change of the position of the eye DE in the vertical direction.

For example, when the position of the eye DE has moved in the forward direction, which is the positive Y-axial direction, the region adjusting unit <NUM> adjusts the position of the region R in the positive U-axial direction. For example, if the position of the eye DE has moved in the rearward direction which is the negative Y-axial direction, the region adjusting unit <NUM> adjusts the position of the region R in the negative U-axial direction.

For example, if the driver leans forward, the position of the eye DE will move in the forward direction, which is the positive Y-axial direction. Moreover, if the driver leans toward the rear, the position of the eye DE will move in the rearward direction, which is the negative Y-axial direction.

The display controlling unit <NUM> displays an image PE on the display <NUM>. the image PE corresponds to the region R for which the position has been adjusted by the region adjusting unit <NUM>. The display controlling unit <NUM> extracts an image PE that corresponds to the region R from the outside image PQ that has been captured by the right outside imaging camera 111R. And the display controlling unit <NUM> displays the extracted image PE on the right display 12R. Moreover, the display controlling unit <NUM> extracts an image PE that corresponds to the region R from the outside image PQ that has been captured by the left outside imaging camera <NUM>. And the display controlling unit <NUM> displays the extracted image PE on the left display <NUM>.

A specific example of a process of the display controlling device will be explained next in reference to <FIG> and <FIG>.

<FIG> is a diagram showing a specific example of a process in the display controlling device <NUM> according to the present embodiment. <FIG> is a diagram showing a specific example of a process in a conventional display controlling device.

The conventional display controlling device differs from the display controlling device <NUM> according to the present embodiment in the points according to below. That is, when there is a change in the position of the head DH so as to move in both the vertical direction and the crosswise direction, the region adjusting unit <NUM> of the display controlling device <NUM> according to the present embodiment prevents an adjustment of the position of the region R to a position corresponding to the change of the position of the eye DE in the vertical direction. In contrast, with the conventional display controlling device, the position of the region R is adjusted to the position corresponding to the change in the position of the eye DE in the vertical direction.

The method for adjusting the position of the region R when there is a change in the position of the head DH of the driver is explained in a case wherein the outside image PQ captured by the right outside imaging camera 111R is a still image in <FIG> and <FIG>. On the other hand, when the display controlling device <NUM> according to the present embodiment is actually used, the outside image PQ is a video that is generated at a predetermined frame rate. For example, the frame rate may be <NUM> FPS.

In <FIG> and <FIG>, a case is explained wherein a part of the outside image PQ that has been captured by the right outside imaging camera 111R is displayed on the right display 12R. <FIG> and <FIG> each include DHM that shows the position of the head, a RPM that shows the position of the region, and PM that shows the image. DHM that shows the position of the head shows the change in the position of the head DH that is detected based on the driver image PD.

RPM that shows the position of the region shows the position of the region R, in the outside image PQ that has been captured by the right outside imaging camera 111R, which has been adjusted by the conventional display controlling device or the display controlling device <NUM>. PM that shows the image shows the changes in the image that is displayed on the right display 12R by the conventional display controlling device or the display controlling device <NUM>.

A specific example of a process in the conventional display controlling device will be explained first in reference to <FIG>.

As showed in DHM that shows the position of the head in <FIG>, the position of the head DH of the driver moves from the position DHA through the position DHB to the position DHC. The position DHA is the position of the head DH when the driver has tilted the head DH toward the right (the positive X-axial direction in <FIG>). The position DHB is the position of the head DH when the driver has not tilted the head DH. The position DHC is the position of the head DH when the driver has tilted the head DH toward the left (the negative X-axial direction in <FIG>).

The position DEA shows the position of the right eye, which is the dominant eye of the driver, when the head DH is at the position DHA. The (X, Y, Z) coordinates of the position DEA are (XA, Y, ZA). The position DEB shows the position of the right eye, which is the dominant eye of the driver, when the head DH is at the position DHB. The (X, Y, Z) coordinates of the position DEB are (XB, Y, ZB). The position DEC shows the position of the right eye, which is the dominant eye of the driver, when the head DH is at the position DHB. The (X, Y, Z) coordinates of the position DEC are (XC, Y, ZC). Note that the value of the Y-coordinate does not change, or the amount of change is no greater than a predetermined threshold value, an amount of change that is negligible. The coordinate XA, the coordinate XB, and the coordinate XC satisfy the following Expression (<NUM>): <MAT>.

Additionally, the coordinate ZA, the coordinate ZB, and the coordinate ZC satisfy the following Expression (<NUM>): <MAT>.

As shown by RPM that shows the position of the region, in <FIG>, when the head DH is at the position DHA, the display controlling device adjusts the region R to the region RA of the outside image PQ. When the head DH is at the position DHB, the display controlling device adjusts the region R to the region RB of the outside image PQ. When the head DH is at the position DHC, the display controlling device adjusts the region R to the region RC of the outside image PQ.

Per Expression (<NUM>) and Expression (<NUM>), the region RA is disposed at a position to the upper left of the region RB, and the region RC is disposed at the upper right of the region RB. Moreover, the region RA is disposed further to the top than the region RC. The region RA, region RB, and region RC each corresponds to an example of a region R.

When the position of the head DH, in a state wherein the head DH of the driver is not tilted, is at the position DHB, the region R is adjusted to the region RB. When the head DH of the driver is tilted to the right (the positive X-axial direction in <FIG>), the region R is adjusted so as to move in the negative U-axial direction in <FIG>, and so as to move in the positive Z-axial direction (region RA). Additionally, when the head DH of the driver is tilted to the left (the negative X-axial direction in <FIG>), the region R is adjusted so as to move in the positive U-axial direction in <FIG>, and so as to move in the positive Z-axial direction (region RC).

As shown in PM that shows the images in <FIG>, when the head DH is at the position DHA, the display controlling device displays the image PA of the region RA in the right display 12R. When the head DH is at the position DHB, the display controlling device displays the image PB of the region RB in the right display 12R. When the head DH is at the position DHC, the display controlling device displays the image PC of the region RC in the right display 12R. The image PA, the region RB, and the image PC each correspond to an example of an image PE.

In this way, the conventional display controlling device moves the region R of the image that is displayed in the right display 12R so as to correspond to the position of the eye DE of the driver in the vertical direction when the position of the eye DE of the driver moves in the vertical direction.

However, the driver may change the actual position of the eye DE in the vertical direction without intending to move in the vertical direction. In this case, the driver may feel uncomfortable with the image PE that is displayed on the display <NUM> due to the movement in the vertical direction. Since the region R of the image displayed in the right display 12R so as to correspond to the position of the eye DE of the driver.

Moreover, it is difficult that the timing of the movement of the region R of the image that is displayed on the right display 12R in the vertical direction matches the timing of the movement of the position of the eye DE in the vertical direction. To detect the position of the eye DE and to extract the image of the region R to display on the right display 12R requires processing time. Because of this, the driver may feel uncomfortable with the image PE that is displayed on the display <NUM>.

In order to eliminate this problem, the region adjusting unit <NUM> of the display controlling device <NUM> according to the present embodiment prevents adjustment of the position of the region R to a position corresponding to the change, in vertical direction, of the position of the eye DE.

A specific example of a process in the display controlling device <NUM> will be explained next in reference to <FIG> is a diagram showing a specific example of a process in the display controlling device <NUM>.

As with <FIG>, <FIG> includes DHM that shows the position of the head, RPM that shows the position of the region, and PM that shows the image. DHM that shows the position of the head, shown in <FIG>, is identical to DHM that shows the position of the head, shown in <FIG>.

As shown in RPM that shows the region position in <FIG>, when the head DH is at the position DHA, the region adjusting unit <NUM> adjusts the region R to the region RA of the outside image PQ. When the head DH is at the position DHB, the region adjusting unit <NUM> adjusts the region R to the region RB of the outside image PQ. When the head DH is at the position DHC, the region adjusting unit <NUM> adjusts the region R to the region RC of the outside image PQ.

Referencing <FIG>, per Expression (<NUM>) and Expression (<NUM>), above, the region RA is disposed at a position to the right (the negative U-axial direction in <FIG>) of the region RB, and the region RC is disposed at a position to the left (the positive U-axial direction in <FIG>) of the region RB.

When the position of the head DH, in a state wherein the head DH of the driver is not tilted, is the position DHB, the region R is adjusted to the region RB. When the head DH of the driver is tilted to the right (the positive X-axial direction in <FIG>), the region R is adjusted so as to move in the negative U-axial direction in <FIG> and movement in the Z-axial direction is prevented (region RA). Additionally, when the head DH of the driver is tilted to the left (the negative X-axial direction in <FIG>), the region R is adjusted so as to move in the positive U-axial direction in <FIG>, and movement in the Z-axial direction is prevented (region RC).

As shown in <FIG> in the part PM that shows the image, the display controlling unit <NUM> displays the image PA of the region RA on the right display 12R when the head DH is at the position DHA. The display controlling unit <NUM> displays the image PB of the region RB in the right display 12R hen the head DH is at the position DHB. When the head DH is at the position DHC, the display controlling unit <NUM> displays the image PC of the region RC in the right display 12R.

The region adjusting unit <NUM> of the display controlling device <NUM> executes the following process when the position of the head DH changes so as to move in the vertical direction and in crosswise direction. Specifically, the region adjusting unit <NUM> adjusts the position of the region R to a position corresponding to the change of the position of the eye DE in the crosswise direction while preventing an adjustment of the position of the region R to a position corresponding to the change of the position of the eye DE in the vertical direction. The region adjusting unit <NUM> can avoid adjusting the position of the region T to a position corresponding to the position of the eye DE in the vertical direction.

This makes it possible to prevent the driver from feeling uncomfortable with the image PE that is displayed on the display <NUM>. Furthermore, because adjustment of the position of the region R to a position corresponding to the change in the vertical direction is prevented, this can shorten the processing time.

An example of a process in the display controlling device <NUM> according to the present embodiment will be explained next in reference to <FIG> is a flowchart showing an example of a process in the display controlling device <NUM> according to the present embodiment. Note that the explanation in <FIG> is for a case wherein the dominant eye of the driver is set in advance to the right eye or left eye.

As illustrated in <FIG>, first, in Step S101, the position detecting unit <NUM> acquires the driver image PD from the driver imaging camera <NUM>.

Next, in Step S103, the position detecting unit <NUM> detects the position of the head DH of the driver based on the driver image PD.

Next, in Step S105, the position detecting unit <NUM> detects the position of the dominant eye DE of the driver based on the driver image PD.

Next, in Step S107, the region adjusting unit <NUM> acquires the outside image PQ from the outside imaging camera <NUM>.

Next, in Step S109, the region adjusting unit <NUM> determines whether or not there has been a change, in the vertical direction, of the position of the head DH of the driver that was detected by the position detecting unit <NUM>.

If the evaluation by the region adjusting unit <NUM> is that the position of the head DH has not changed in the vertical direction (Step S109: NO), processing advances to Step S113. If the evaluation by the region adjusting unit <NUM> is that the position of the head DH has changed in the vertical direction (Step S109: YES), processing advances to Step S111.

Given this, in Step S111, the region adjusting unit <NUM> prevents an adjustment of the position of the region R depending on the change in position, in the vertical direction, of the dominant eye of the driver.

Next, in Step S113, the region adjusting unit <NUM> adjusts the position of the region R in accordance with the change of the position of the dominant eye of the driver except for in the vertical direction (that is, in the crosswise direction and in the front/rear direction).

Next, in Step S115, the display controlling unit <NUM> extracts, from the outside image PQ that has been captured by the outside imaging camera <NUM>, the image PE that corresponds to the region R of the position adjusted by the region adjusting unit <NUM>.

Next, in Step S117, the display controlling unit <NUM> displays, on the display <NUM>, the image PE that was extracted in Step S115.

Next, in Step S119, the display controlling device <NUM> determines whether or not to terminate the display process. The "display process" is the process for displaying the image PE on the display <NUM>, that is, the process that is structured from Step S101 through Step S117 in <FIG>. The display controlling device <NUM>, for example, receives an operation from the driver and determines whether or not to terminate the display process depending on the operation that has been received.

If the evaluation is that the display process is not to be terminated (Step S119: NO), processing returns to Step S101. If the evaluation is to terminate the display process (Step S119: YES), the process is then terminated.

Step S103 and Step S105 correspond to examples of a "detecting step. " Step S113 corresponds to an example of an "adjusting step. " Step S117 corresponds to an example of a "displaying step.

Note that when the driver boards the vehicle and sits in the driver seat, the process described in <FIG> is not executed. Specifically, the driver boards the vehicle and sits in the driver seat, and when the region adjusting unit <NUM> has set a reference position for the region R matching the height of the body or eye of the driver, imaged by the driver imaging camera <NUM>, the process described in <FIG> is not executed. Thus the present invention does not interfere with setting the reference position for the region R to match the body of the driver.

As explained above in reference to <FIG>, the display controlling device <NUM> according to the present embodiment is a display controlling device <NUM> for displaying an outside image PQ, which is an image to the outside of the vehicle <NUM>, as if seeing through the vehicle body <NUM> of the vehicle <NUM>, on a display <NUM> that is mounted in the interior of the vehicle <NUM>, comprising: a position detecting unit <NUM> for detecting the position of the head DH of the driver and the position of an eye DE of the driver; a region adjusting unit <NUM> for adjusting the position of the region R, to be displayed on the display <NUM>, from the outside image PQ depending on the detection results by the position detecting unit <NUM>; and a display controlling unit <NUM> for displaying, on the display <NUM>, an image PE that corresponds to the region R for which the position has been adjusted by the region adjusting unit <NUM>, wherein: when there is a change in the position of the head DH so as to move in the vertical direction and crosswise direction of the vehicle <NUM>, the region adjusting unit <NUM> prevents an adjustment of the position of the region R to a position corresponding to the change, in the vertical direction, of the position of the eye DE, and adjusts the position of the region R to a position that corresponds to the change, in the crosswise direction, of the position of the eye DE.

When the position of the head DH has changed so as to move in both the vertical direction of the vehicle <NUM> and the crosswise direction of the vehicle <NUM>, the region adjusting unit <NUM> executes the following process. Specifically, the region adjusting unit <NUM> adjusts the position of the region R to a position corresponding to the change of the position of the eye DE in the crosswise direction while preventing an adjustment of the position of the region R to a position corresponding to the change of the position of the eye DE in the vertical direction. In other words, the region adjusting unit <NUM> moves the position of the region R in the crosswise direction, without moving it in the vertical direction.

The result is that this can prevent the driver from feeling the discomfort with the image PE that is displayed on the display <NUM> that would be caused by the movement of the position of the region R in the vertical direction.

Moreover, in the display controlling device <NUM>, when the position of the head DH has changed so as to move in both the vertical direction and the front/rear direction of the vehicle <NUM>, the region adjusting unit <NUM> adjusts the position of the region R to a position corresponding to the change of the position of the eye DE in the front/rear direction while preventing an adjustment of the position of the region R to a position corresponding to the change of the position of the eye DE in the vertical direction.

Moreover, in the display controlling device <NUM>, the position detecting unit <NUM> detects, as the position of the eye DE of the driver, the position of the dominant eye of the driver.

Through this, the region adjusting unit <NUM> adjusts the position of the region R to a position that corresponds to a change in the position of the dominant eye in the crosswise direction and/or the front/back direction. This enables the position of the region R to be adjusted properly. The result is the ability to display the image PE appropriately on the display <NUM>.

Moreover, in the display controlling device <NUM>, when the position of the head DH has changed so as to move in both the vertical direction of the vehicle <NUM> and the crosswise direction of the vehicle <NUM>, the region adjusting unit <NUM> adjusts the position of the region R to a position corresponding to the change of the position of the eye DE in the crosswise direction while preventing an adjustment of the position of the region R to a position corresponding to the change of the position of the eye DE in the vertical direction.

That is, when there has been a change in the position of the head DH so as to move in the vertical direction of the vehicle <NUM> and in the crosswise direction of the vehicle <NUM>, the region adjusting unit <NUM> prevents the adjustment of the position of the region R to a position corresponding to the change, in the vertical direction, of the position of the eye DE. The result is that this can prevent the driver from feeling the discomfort with the image PE that is displayed on the display <NUM> that would be caused by the movement of the position of the region R in the vertical direction when there has been a change in the position of the head DH so as to move in the vertical direction of the vehicle <NUM> and in the crosswise direction of the vehicle <NUM>.

Moreover, in the display controlling device <NUM>, when the position of the head DH has changed so as to move in both the vertical direction of the vehicle <NUM> and the front/back direction of the vehicle <NUM>, the region adjusting unit <NUM> adjusts the position of the region R to a position corresponding to the change of the position of the eye DE in the front/back direction while preventing an adjustment of the position of the region R to a position corresponding to the change of the position of the eye DE in the vertical direction.

That is, when there has been a change in the position of the head DH so as to move in the vertical direction of the vehicle <NUM> and in the front/back direction of the vehicle <NUM>, the region adjusting unit <NUM> prevents the adjustment of the position of the region R to a position corresponding to the change, in the vertical direction, of the position of the eye DE. The result is that this can prevent the driver from feeling the discomfort with the image PE that is displayed on the display <NUM> that would be caused by the movement of the position of the region R in the vertical direction when there has been a change in the position of the head DH so as to move in the vertical direction of the vehicle <NUM> and in the front/back direction of the vehicle <NUM>.

Moreover, in the display controlling device <NUM>, the vehicle body <NUM> includes A-pillars <NUM>, and the display <NUM> includes a right display 12R and a left display <NUM> that are mounted on the A-pillars <NUM>.

Through this, the right display 12R and the left display <NUM> are mounted on the A-pillars <NUM>, enabling the image PE to be displayed as if it is possible to see through the A-pillars <NUM>. This makes it possible to prevent the A-pillars <NUM> from blocking the field of view of the driver.

Moreover, in the display controlling device <NUM>, when the driver boards the vehicle <NUM>, the region adjusting unit <NUM> does not prevent adjustment of the position of the front region R to a position corresponding to the change, in the vertical direction, of the position of the eye DE.

Through this, when the driver has boarded the vehicle <NUM>, the region adjusting unit <NUM> adjusts the position of the region R to a position that corresponds to the change of the position of the eye DE in the vertical direction. This enables the position of the region R to be adjusted appropriately when the driver has boarded the vehicle <NUM>.

Moreover, a display controlling method according to the present embodiment is a display controlling method for a display controlling device <NUM> to display the outside image PQ, which is an image of the outside of the vehicle <NUM>, on a display <NUM> that is mounted within the vehicle <NUM>, so as to appear as if one is looking through the vehicle body <NUM> of the vehicle <NUM>, including: a detecting step for detecting a position of the head DH of the driver and a position of an eye DE of the driver; an adjusting step for adjusting the position of the region R, which is to be displayed on the display <NUM>, in the outside image PQ in accordance with a detection result from the detecting step; and a displaying step for displaying, on the display <NUM>, an image PE that corresponds to the region R for which the position has been adjusted in the adjusting step, wherein: when there is a change in the position of the head DH so as to move in both the vertical direction and the crosswise direction of the vehicle <NUM>, then, in the adjusting step, adjustment of the position of the region R to a position corresponding to the change, in the vertical direction, of the position of the eye DE is prevented, and the position of the region R is adjusted to a position that corresponds to the change, in the crosswise direction, of the position of the eye DE.

As a result, the display supporting method according to the present embodiment has the same effects as the display controlling device <NUM> according to the present embodiment.

The embodiment according to above is no more than an illustration of one form of the present invention.

For example, for ease in understanding the present invention, <FIG> is a diagram wherein the structural elements are shown partitioned into the main processing details, and the structural elements may be partitioned into more structural elements depending on the processing details. Moreover, the partitioning may be such that more processes are carried out by a single structural element.

Moreover, the processes in any of the structural elements may be executed in a single hardware or executed by a plurality of hardware. Moreover, the processes of each structural element may be achieved by a single program, or by a plurality of programs.

Moreover, in <FIG> the display controlling device <NUM> may be integrated with the imaging unit <NUM> and/or the display <NUM>.

Furthermore, while in the present embodiment a position detecting unit <NUM>, a region adjusting unit <NUM>, and a display controlling unit <NUM> are provided, there is no limitation thereto. A server device that is connected to the display controlling device <NUM> so as to enable communication through a network such as the Internet may provide the position detecting unit <NUM>, the region adjusting unit <NUM>, and/or the display controlling unit <NUM>.

Moreover, while in the present embodiment the explanation was for a case wherein the position detecting unit <NUM> detects the position of the dominant eye of the driver as the position of the eye DE, there is no limitation thereto. Instead the position detecting unit <NUM> may detect, for example, a central position of the two eyes as the position of the eye DE.

In addition, while the explanation in the present invention was for a case wherein the display <NUM> is mounted on the A-pillars <NUM>, there is no limitation thereto. The display <NUM> need only be disposed in a position in the vehicle body <NUM> wherein the field of view of the driver is blocked. For example, the display <NUM> may be mounted on the B-pillars, or the like.

In addition, while the explanation in the present invention was for a case wherein the outside imaging cameras <NUM> are mounted on the A-pillars <NUM>, there is no limitation thereto. The outside imaging cameras <NUM> need only be mounted at positions wherein it is possible to capture the outside image PQ.

Moreover, while in the present embodiment, when the position detecting unit <NUM> detects a change in the head position DH and in the position of the eye DE, the reference was the Y axis that is the front/rear direction of the vehicle <NUM> and the Y axis that is the crosswise direction of the vehicle <NUM>, the X axis may be replaced with the U axis and the Y axis may be replaced with the V axis in detecting the change of the head position DH and the position of the eye DE.

Additionally, if the display controlling method according to the present invention is achieved using a computer, it may be structured in the form of a medium on which is recorded a control program <NUM> that is executed by a computer, or a transmission medium for transmitting the control program <NUM>.

The recording medium may use a magnetic or optical recording medium, or a semiconductor memory device. Specifically, it may be a fixed recording medium or a portable recording medium such as a flexible disk, an HDD, a CD-ROM (Compact Disk Read-Only Memory), a DVD, a Blu-ray® disc, a magnetooptical disc, a flash memory, a card-type recording medium, or the like. Moreover, the recording medium may be a RAM, a ROM, or a non-volatile storage device, such as an HDD, provided by the display controlling device <NUM>.

Additionally, the display controlling device <NUM> may download the control program <NUM> from a server device that is connected communicatively through a network to the display controlling device <NUM>.

Claim 1:
A display controlling device (<NUM>) for displaying, on a display (<NUM>) mounted inside a vehicle on a vehicle body, an image of outside of the vehicle (<NUM>) so as to appear as if looking through the vehicle body of the vehicle, comprising:
a position detecting unit (<NUM>) configured to detect a position of the head of the driver and a position of an eye of the driver;
a region adjusting unit (<NUM>) configured to adjust a position of a region, of the image of the outside of the vehicle, displayed on the display, depending on a detection result by the position detecting unit; and
a display controlling unit (<NUM>) configured to display, on the display, an image corresponding to the region at the position adjusted by the region adjusting unit, characterized in that
the region adjusting unit (<NUM>) is further configured to prevent adjustment of the position of the region to a position corresponding to a change of the position of the eye in a vertical direction and to adjust the position of the region to a position corresponding to a change of the position of the eye in the crosswise direction, when the position of the head has changed so as to move in both the vertical direction and the crosswise direction of the vehicle.