VEHICLE AND METHOD OF CONTROLLING THE SAME

A vehicle includes a driver sensor provided inside the vehicle and configured to obtain a face image of a driver; a side camera configured to obtain images of a rear left side and a rear right side of the vehicle; a display configured to output the images of the rear left side and the rear right side of the vehicle; and a controller electrically connected to the driver sensor, the side camera, and the display; wherein the controller is configured to identify a gaze direction of the driver based on the face image of the driver, and adjust at least one of a frame rate of the side camera or a screen brightness of the display based on the gaze direction of the driver.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit of priority to Korean Patent Application No. 10-2021-0082303, filed on Jun. 24, 2021, the disclosure of which is incorporated herein by reference.

TECHNICAL FIELD

The disclosure relates to a vehicle including a digital side mirror and a method of controlling the same.

BACKGROUND

In general, vehicles have side mirrors on their doors. The side mirrors protrude from an outer surface of the door by a predetermined length, and provide a driver with a rear view, a rear left view, and a rear right view of the vehicle. A conventional side mirrors include a plate part formed of a glass material.

Recently, digital side mirrors including cameras have been developed and applied to a vehicle. The digital side mirrors may include the cameras provided on an outer surface of the door and a display provided inside the vehicle. The cameras capture rear left side and rear right side of the vehicle, and an image of the rear left and right sides captured by the cameras is output through the display.

Digital side mirrors are powered by a vehicle's battery and continuously consume power while the vehicle is operating. However, when the digital side mirrors are always operating at peak performance, power consumption may increase and an amount of charge of a battery may decrease relatively quickly. Furthermore, a driving distance of the vehicle may be shortened due to the power consumption of the digital side mirrors.

SUMMARY

An aspect of the disclosure is to provide a vehicle capable of reducing power consumption by controlling an operation of a side camera and a display, which are constituting digital side mirrors, and a method of controlling the same.

According to an aspect of the disclosure, a vehicle includes a driver sensor disposed inside the vehicle and configured to obtain a face image of a driver; a side camera configured to obtain images of a rear left side and a rear right side of the vehicle; a display configured to output the images of the rear left side and the rear right side of the vehicle; and a controller electrically connected to the driver sensor, the side camera, and the display; wherein the controller is configured to identify a gaze direction of the driver based on the face image of the driver, and adjust at least one of a frame rate of the side camera and a screen brightness of the display based on the gaze direction of the driver.

The controller may increase the at least one of the frame rate of the side camera or the screen brightness of the display based on the gaze direction of the driver toward the display, and decrease the at least one of the frame rate of the side camera or the screen brightness of the display based on the gaze direction of the driver deviating from the display.

The controller may increase the at least one of the frame rate of the side camera or the screen brightness of the display based on an identification of an object located on at least one of the rear left side or the rear right side of the vehicle in a state in which the gaze direction of the driver is out of the display.

The controller may identify the object located on at least one of the rear left side or the rear right side of the vehicle based on the images of the rear left side and the rear right side obtained by the side camera.

The vehicle may further include a sensor disposed on a rear of the vehicle and configured to obtain object data; wherein the controller is further configured to identify the object based on the object data obtained by the sensor.

The vehicle may further include a memory configured to store driver's behavior pattern data associated with the gaze direction of the driver; wherein the controller is further configured to predict the gaze direction of the driver caused by a driver's behavior based on the driver's behavior pattern data, and increase the at least one of the frame rate of the side camera positioned in the predicted gaze direction of the driver or the screen brightness of the display positioned in the predicted gaze direction of the driver.

The controller may predict the gaze direction of the driver based on at least one of rotation of a steering device or flashing of a turn indicator lamp.

The vehicle may further include a navigation system configured to guide a driving route to a destination set by the driver; wherein the controller is further configured to predict the gaze direction of the driver based on a left turn guidance, a right turn guidance, or a lane change guidance by the navigation system, and increase in advance the at least one of the frame rate of the side camera positioned in the predicted gaze direction of the driver or the screen brightness of the display positioned in the predicted gaze direction of the driver.

The controller may determine at least one of an adjustment value of the frame rate of the side camera or an adjustment value of the screen brightness of the display based on a predetermined sensitivity of the driver.

The side camera may include a first side camera disposed on a door of the driver side and a second side camera disposed on a door of a front passenger side.

The display may include a first display disposed on a driver seat side and a second display disposed on a front passenger seat side.

According to another aspect of the disclosure, a method of controlling a vehicle, the method comprising obtaining, by a driver sensor disposed inside the vehicle, a face image of a driver; obtaining, by a side camera, images of a rear left side and a rear right side of the vehicle; displaying, by a display, the images of the rear left side and the rear right side of the vehicle; identify, by a controller, a gaze direction of the driver based on the face image of the driver; and adjusting, by the controller, at least one of a frame rate of the side camera or a screen brightness of the display based on the gaze direction of the driver.

The adjusting may include increasing, by the controller, the at least one of the frame rate of the side camera and the screen brightness of the display based on the gaze direction of the driver toward the display; and decreasing, by the controller, the at least one of the frame rate of the side camera or the screen brightness of the display based on the gaze direction of the driver deviating from the display.

The adjusting may include increasing, by the controller, the at least one of the frame rate of the side camera or the screen brightness of the display based on an identification of an object located on at least one of the rear left side or the rear right side of the vehicle in a state in which the gaze direction of the driver is out of the display.

The object located on at least one of the rear left side or the rear right side of the vehicle may be identified based on the images of the rear left and right sides obtained by the side camera.

The object located on the rear left and right sides of the vehicle may be identified based on object data obtained by a sensor disposed on a rear of the vehicle.

The adjusting may include predicting, by the controller, the gaze direction of the driver caused by a driver's behavior based on driver's behavior pattern data associated with the gaze direction of the driver, and increasing, by the controller, the at least one of the frame rate of the side camera positioned in the predicted gaze direction of the driver or the screen brightness of the display positioned in the predicted gaze direction of the driver.

The predicting may be based on at least one of turning of a steering device and flashing a turn indicator lamp.

The adjusting may include predicting, by the controller, the gaze direction of the driver based on a left turn guidance, a right turn guidance, or a lane change guidance by a navigation system, and increasing, by the controller, in advance the at least one of the frame rate of the side camera positioned in the predicted gaze direction of the driver or the screen brightness of the display positioned in the predicted gaze direction of the driver.

The adjusting may include determining, by the controller, at least one of an adjustment value of the frame rate of the side camera or an adjustment value of the screen brightness of the display based on a predetermined sensitivity of the driver.

DETAILED DESCRIPTION

Like numerals refer to like elements throughout the specification. Not all elements of embodiment of the disclosures of the disclosure will be described, and description of what are commonly known in the art or what overlap each other in the embodiment of the disclosures will be omitted.

Further, when it is stated that a member is “on” another member, the member may be directly on the other member or a third member may be disposed therebetween.

Terms such as “˜ unit”, “˜ group”, “˜ block”, “˜ member”, and “˜ module” used in the specification may be implemented in software and/or hardware. Terms such as “˜ unit”, “˜ group”, “˜ block”, “˜ member”, and “˜ module” may refer to a unit that processes at least one function or operation. In addition, terms such as “˜ unit”, “˜ group”, “˜ block”, “˜ member”, and “˜ module” are used in at least one piece of hardware such as a field-programmable gate array (FPGA)/application specific integrated circuit (ASIC), or at least one software or processor stored in a memory.

Although the terms “first,” “second,” “A,” “B,” etc. may be used to describe various components, the terms do not limit the corresponding components, but are used only for the purpose of distinguishing one component from another component.

Hereinafter, embodiments of the disclosure related to a vehicle and a method of controlling the same will be described in detail with reference to the accompanying drawings.

FIG.1is a view illustrating an exterior of a vehicle according to an exemplary embodiment of the disclosure.FIG.2is a view illustrating an interior of a vehicle according to an embodiment of the disclosure.

Referring toFIG.1, a vehicle1includes a body having an exterior and an interior, and a chassis in which mechanical components required for driving are installed as the remaining parts except for the body. The exterior of the body may include a front panel, a roof panel, a rear panel, a plurality of doors115a,115b,115c, and115d(115), and a plurality of window glasses. The door115may be provided with a door locking device for opening and closing.

Furthermore, the vehicle1may include a tailgate that opens and closes a trunk that provides a space for storing things, a front light to secure a front view, a rear light to notify deceleration or stop of the vehicle, and a flasher provided at the front and rear of the vehicle to serve as a turn indicator and an emergency light.

Furthermore, the vehicle1may include a sensor110that detects a surrounding object and digital side mirrors130L and130R (130) that provide a driver with a rear view, a rear left side view, and a rear right side view of the vehicle1.

The sensor110may detect an object around the vehicle. The sensor110may include an image sensor and/or radar, and may obtain object data such as a type of object (e.g., a surrounding vehicle, a pedestrian, a lane, a road sign, and a traffic light), a location of the object, a speed of the object, and a distance to the object.

At least one sensor110may be provided. For example, the sensor110may include a first corner sensor110-1installed on a rear left side of the vehicle1and a second corner sensor110-2installed on a rear right side of the vehicle1. The first corner sensor110-1may have a detection view directing toward the rear left of the vehicle1, and the second corner sensor110-2may have a detection view directing toward the rear right of the vehicle1. Furthermore, the sensor110may be installed in each of the front and front corners of the vehicle1. For example, the sensor110may be installed in a front window and/or a bumper of the vehicle1.

The digital side mirrors130L and130R (130) may be provided on the door115, photograph the rear left and right sides of the vehicle1to obtain an image of the rear left and right, and output the image of the rear left and right sides of the vehicle. At least one digital side mirror130may be provided. For example, the digital side mirrors130include a first digital side mirror130L installed adjacent to A pillar of the door115aof driver side and a second digital side mirror130R installed adjacent to A pillar of the door115bof (front) passenger side. The first digital side mirror130L may have a field of view facing a rear left RL, and the second digital side mirror130R may have a field of view facing a rear right RR.

Referring toFIG.2, the first digital side mirror130L may include a first side camera131L and a first display132L. The first display132L may output a rear left image obtained by the first side camera131L. The first display132L may be provided on a driver seat side. For example, the first display132L may be installed inside the door115aof driver side, a part of a dashboard122adjacent to the door115aof driver side, or inside the A pillar of the door115aof driver side.

The second digital side mirror130R may include a second side camera131R and a second display132R. The second display132R may output a rear right image obtained by the second side camera131R. The second display132R may be provided on a passenger seat side. For example, the second display132R may be installed inside the door115bof the (front) passenger side, a part of the dashboard122adjacent to the door115bof the passenger side, or inside the A pillar of the door115bof the passenger side.

Furthermore, the digital side mirrors130L and130R (130) may include a housing a1for protecting the side cameras131L and131R (131), and a folding part a2for automatically folding or unfolding the housing a1. For example, when the vehicle1is started off or a remote controller such as a smart key moves out of a predetermined distance from the vehicle1, the housing a1may be folded toward the door115by the folding part a2. Conversely, when the vehicle1is started on or the remote controller such as the smart key is located within the predetermined distance from the vehicle1, the housing a1may be unfolded in the opposite direction to the folding direction by the folding part a2.

The interior of the vehicle1may include a seat, the dashboard122, a center fascia123, and a head unit124. A third display151and a fourth display152may be provided on the dashboard122. The third and fourth displays151and152are illustrated as being separated, but the third and fourth displays151and152may be integrally formed. Furthermore, the display may be provided at various positions inside the vehicle1.

The third display151may serve as an instrument panel (a cluster). The third display151may display vehicle state information and driving information. For example, the third display151may display a tachometer, a speedometer, a coolant thermometer, a fuel gauge, a turn indicator, a high beam indicator, a warning lamp, a seat belt warning lamp, an odometer, a tachograph, an gear shift indicator (automatic transmission), a door open warning lamp, engine oil warning light, and low fuel warning light, and the like.

The fourth display152may be included in an audio video navigation (AVN) device, and may output various information related to a function, state, and/or operation of the vehicle1. The fourth display152may output a graphic user interface (GUI) including an object (e.g., icon, text, image, etc.) for executing or setting various functions of the vehicle1. The GUI may interact with user input. The fourth display152may output a screen corresponding to an input to the object. For example, the fourth display152may display a driving route to a destination set by the driver, and display various graphic user interfaces for guiding the driving route.

Various input devices125may be provided in the center fascia123and the head unit124. Furthermore, the input devices may be provided in a steering device (steering wheel), an armrest, a door handle, and seats. The input device125may include buttons, dials, and/or touchpads related to various functions of the vehicle1. For example, the input devices125may include a push button, a touch button, a touch pad, a touch screen, a dial, a stick-type operation device, and/or a track ball.

Furthermore, a driver sensor140may be provided inside the vehicle1. The driver sensor140may be implemented as a camera as an image sensor. The driver sensor140may photograph the driver and obtain a face image of the driver. A location where the driver sensor140is installed is not particularly limited. Because the driver mostly looks forward when the vehicle1is traveling, the driver sensor140is preferably installed at a position in front of the driver. For example, the driver sensor140may be installed on the instrument panel (cluster) or on a ceiling above the driver seat.

Furthermore, the vehicle1may include an audio device. At least one audio device may be provided, and may be installed inside the dashboard and/or the door. A sound (e.g., a voice, a warning sound) related to the function, state, and/or operation of the vehicle1may be output through the audio device. The audio device may include at least one speaker.

Furthermore, the vehicle1may include various devices for operating the vehicle1. For example, the vehicle1may include a power generating device, a power transmission device, a driving assistance device, a steering device, a braking device, an accelerator, a suspension device, a transmission device, a fuel device, wheels and/or a battery. In addition, the vehicle10may include a plurality of electrical components. For example, the vehicle10may include an electromechanical steering system, a body control module, and a driver assistance system, and a navigation system160.

Electrical components of the vehicle1may communicate with each other via a vehicle communication network (NT). For example, the electrical components may transmit and receive data using the NT, such as an Ethernet, a Media Oriented Systems Transport (MOST), a Flexray, a Controller Area Network (CAN) and/or a Local Interconnect Network (LIN).

FIG.3is a control block diagram illustrating a vehicle according to an exemplary embodiment of the disclosure.

Referring toFIG.3, the vehicle1may include the sensor110, an input device125, the first digital side mirror130L, the second digital side mirror130R, the driver sensor140, the third display151, the fourth display152, the navigation system160, and a controller200. The controller200may be electrically connected to devices provided in the vehicle1and may control each device.

The sensor110may detect the object around the vehicle1and obtain object data. For example, the sensor110may detect the object located on the rear left and right sides of the vehicle1, and may obtain the object data such as the type of object, the location of the object, the speed of the object, and the distance to the object. The sensor110may transmit the obtained object data to the controller200.

The input device125may obtain a user input. For example, the input device125may include a direction indicator lever, and may obtain the user input operating the direction indicator lever to blink the direction indicator lamp. Meanwhile, the steering device (steering wheel) for controlling moving direction of the vehicle1may be also defined as included in the input device125.

The first digital side mirror130L may include the first side camera131L and the first display132L. The first display132L may output the rear left image obtained by the first side camera131L. The second digital side mirror130R may include the second side camera131R and the second display132R. The second display132R may output the rear right image obtained by the second side camera131R.

The driver sensor140may photograph the driver and obtain the face image of the driver. The driver sensor140may be implemented as a camera as an image sensor. Furthermore, the driver sensor140may include a face analysis device capable of analyzing a user's facial expression and an eye tracker capable of tracking the position of the pupil. The driver sensor140may be installed in different positions inside the vehicle1, but is preferably installed in a position in front of the driver.

The third and fourth displays151and152may be provided on the dashboard122. The third and fourth displays151and152may be provided in a separately or integrally. The third display151may serve as the instrument panel (cluster). The fourth display152may be included in the AVN device, and may output various information related to the function, state, and/or operation of the vehicle1.

Each of the first display132L, the second display132R, the third display151, and the fourth display152may include a light emitting diode (LED) panel, an organic light emitting diode (OLED) panel, or a liquid crystal display (LCD) panel. Furthermore, the first display132L, the second display132R, the third display151, and the fourth display152may include a touch screen.

The navigation system160may obtain current location information of the vehicle1and guide the driving route from the current location to the destination set by the driver. The driving route set by the navigation system160may be guided through the third display151and/or the fourth display152. For example, the navigation system160may perform a left turn guidance, a right turn guidance, or a lane change guidance based on the driving route.

The controller200may be electrically connected to the electrical devices of the vehicle1to control the respective devices. The controller200may include a processor210and a memory220. The memory220may store a program, an instruction, and/or an application for performing a remote control method of a vehicle. The processor210may execute programs, instructions, and/or applications stored in the memory220. The processor210and the memory220may be provided in plurality. The controller200may include control units such as an Electronic Control Unit (ECU) or a Micro Controller Unit (MCU).

The memory220may include a non-volatile memory device such as a cache, a read only memory (ROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), and a flash memory. Furthermore, the memory220may include a volatile memory device such as a random access memory (RAM), and may include a storage medium such as a hard disk drive (HDD) or a compact disk ROM (CD-ROM). The type of the memory220is not limited to what is illustrated.

In addition to the above-described configurations, the vehicle1may include various devices. Furthermore, some of the above-described configurations may be omitted in the vehicle1. Hereinafter, the method of controlling the vehicle1will be specifically described.

FIG.4is a flowchart illustrating a method of controlling a vehicle according to an exemplary embodiment of the disclosure.FIG.5is a flowchart illustrating in more detail the method of controlling the vehicle illustrated inFIG.4.

Referring toFIGS.4and5, the controller200of the vehicle1may control the driver sensor140to obtain the face image of the driver, and receive the face image of the driver from the driver sensor140(in operation401). In addition, the controller200may control the at least one side cameras131L or131R to obtain the view of rear left and right sides of the vehicle1(in operation402). The controller200may control at least one displays132L or132R to output the image of the rear left and right sides of the vehicle1(in operation403). For example, the image of the rear left side obtained by the first side camera131L is output through the first display132L, and the image of rear right obtained by the second side camera131R is output through the second display132R.

The controller200may identify a gaze direction of the driver based on the face image of the driver (in operation404). The face image may include a driver's facial movement and eye movement. The gaze of the driver changes when the driver turns his/her head to look left or right instead of looking straight ahead while driving. Alternatively, the driver may look left or right by moving only their eyes. The controller200may identify the direction in which the driver is looking by analyzing the drivers facial movement and eye movement.

The controller200may adjust at least one of a frame rate of the side cameras131L and131R or a screen brightness of the displays132L and132R based on the gaze direction of the driver (in operation405). The controller200may adjust the frame rate of the at least one of the first and second side cameras131L and131R, and/or the screen brightness of the at least one of the first and second displays132L and132R. For example, the frame rate of the side cameras131L and131R may be adjusted between 1 fps (frames per second) and 120 fps. The screen brightness of the displays132L and132R may be adjusted from1to100.

As the frame rate of the side cameras131L and131R increases, the number of image frames obtained per second increases. When the frame rate of the side cameras131L and131R is increased, a high-quality image of the rear left and right sides may be obtained. As the screen brightness of the displays132L and132R increases, a visibility of the image of the rear left and right sides increases. Accordingly, in response to the frame rate of the side cameras131L and131R increasing and the screen brightness of the displays132L and132R increasing, the driver may more clearly see the image of the rear left and right sides output.

Specifically, referring toFIG.5, the controller200may increase at least one of the frame rate of the side cameras131L and131R and/or the screen brightness of the displays132L and132R based on the gaze direction of the driver directing toward the displays132L and132R (in operations501and503). The controller200may decrease the frame rate of the side cameras131L and131R and/or the screen brightness of the displays132L and132R based on the gaze direction of the driver deviating from the displays132L and132R. The controller200may increase the frame rate of the side cameras131L and131R and/or the screen brightness of the displays132L and132R based on the identification of the object located on the rear left and right sides of the vehicle1in a state where the gaze direction of the driver is out of the displays132L and132R (in operations502and504).

The driver needs to look at the first display132L or the second display132R to identify the rear left and right sides of the vehicle1. For example, the driver may look at the first display132L by turning his/her head to the left or moving the pupil to the left to check the rear left side of the vehicle1. In this case, by increasing the frame rate of the first side camera131L positioned in the gaze direction of the driver and simultaneously increasing the screen brightness of the first display132L positioned in the gaze direction of the driver, the driver may see more clearly the rear left side of the vehicle1.

It is impossible for the driver to see the second display132R positioned on the right side of the vehicle1while looking at the first display132L positioned on the left side of the vehicle1. In other words, when the driver looks at the first display132L, it is not necessarily required to maintain highly the performance of the second side camera131R and the performance of the second display132R. Accordingly, when the driver looks at the first display132L, decreasing the frame rate of the second side camera131R and decreasing the screen brightness of the second display132R helps to reduce power consumption of the battery.

Furthermore, when the gaze direction of the driver moves from the first display132L to the second display132R, the controller200may decrease the frame rate of the first side camera131L and decrease the screen brightness of the first display132L. At the same time, the controller200may increase the frame rate of the second side camera131R and increase the screen brightness of the second display132R.

However, even if the gaze of direction of the driver is out of the second display132R, when an object approaching the vehicle1is detected from the rear right side of the vehicle1, a risk of an accident may occur. Accordingly, when an object approaching the vehicle1is identified in the image of rear right obtained by the second side camera131R, the controller200may increase the frame rate of the second side camera131R and increase the screen brightness of the second display132R so that the driver may clearly see the rear right side of the vehicle1. The controller200may identify an object located on the rear left and right sides of the vehicle1based on the image of rear left and right sides obtained by the side cameras131L and131R. Furthermore, the controller200may identify the object located on the rear left and right sides of the vehicle1based on the object data obtained by the sensor110.

Meanwhile, if the driver is looking at the front (forward) of the vehicle1, the first and second digital side mirrors130L and130R may operate based on a predetermined default setting value. In other words, both the first and second side cameras131L and131R may operate at a predetermined default frame rate (e.g., 30 fps), and the first and second displays132L and132R may all operate with a predetermined default screen brightness (e.g.,50).

If the gaze direction of the driver faces the first display132L located on the left, from the front or the right, the controller200may set the frame rate of the first side camera131L to a first frame rate (e.g., 60 fps) higher than the default frame rate, and set the screen brightness of the first display132L to a first brightness (e.g.,80) higher than the default screen brightness. At the same time, the controller200may set the frame rate of the second side camera131R to the default frame rate or a second frame rate lower than the default frame rate (e.g., 20 fps), and set the screen brightness of the second display132R to the default screen brightness or a second brightness lower than the default screen brightness (e.g.,40).

Furthermore, the controller200may determine at least one of a frame rate adjustment value of the side cameras131L and131R or a screen brightness adjustment value of the displays132L and132R based on a predetermined driver's sensitivity. The driver may set the sensitivity by manipulating the input device125. For example, the sensitivity of the driver may be selected as low, medium or high. Based on the gaze direction of the driver, the frame rate of the side cameras131L and131R and the screen brightness of the displays132L and132R may be changed by the adjustment values, respectively.

The low sensitivity of the driver refers to that the driver is not easily aware of small changes in frame rate and small changes in screen brightness. Accordingly, when the sensitivity of the driver is set to low, the adjustment value of the frame rate and the adjustment value of the screen brightness may be determined to be the largest. Conversely, the high sensitivity of the driver refers to that the driver easily perceives small changes in frame rate and small changes in screen brightness. Accordingly, when the sensitivity of the driver is set to high, the adjustment value of the frame rate and the adjustment value of the screen brightness may be determined to be the smallest. The adjustment value of the frame rate and the adjustment value of the screen brightness corresponding to the sensitivity of the driver may be selected differently depending on the design.

The conventional digital side mirrors may not adaptively adjust the frame rate of the camera and the screen brightness of the display in response to the gaze direction of the driver and a driving situation. In other words, the conventional digital side mirrors operate at a fixed frame rate and fixed brightness unless the driver manually changes the settings of the camera and display. Accordingly, constant power consumption is continuously generated.

However, in method of controlling the vehicle of the disclosure, power consumption may be optimized by automatically adjusting the frame rate of the side camera and the screen brightness of the display based on the gaze direction of the driver. Furthermore, the method of controlling the vehicle of the disclosure may automatically adjust the frame rate of the side camera and the screen brightness of the display in a situation in which the driver is required to look at the digital side mirror. As a result, occurrence of accidents may be reduced and power consumption may be optimized.

FIG.6is a flowchart illustrating a method of controlling a vehicle using a driver's behavior pattern as a partial modified example of the method of controlling the vehicle illustrated inFIG.4.

Referring toFIG.6, the controller200of the vehicle1may control the driver sensor140to obtain the face image of the driver, and receive the face image of the driver from the driver sensor140(in operation401). Furthermore, the controller200may control at least one side camera131L or131R to obtain the image of the rear left and right sides of the vehicle1(in operation402). The controller200may control at least one display132L or132R to output the image of the rear left and right sides of the vehicle1(in operation403).

Furthermore, the memory220may store a driver's behavior pattern data related to the gaze direction of the driver. When the vehicle1is driving, the driver's gaze is related to the driver's behavior. The controller200may control the driver sensor140to monitor the driver's behavior. Behavioral pattern data may be continuously updated. The controller200may predict the gaze direction of the driver from the driver's behavior based on the driver's behavior pattern data stored in the memory220(in operation601).

For example, the controller200may predict the gaze direction of the driver based on at least one of rotation of the steering device (steering wheel) or flashing of the direction indicator. If the driver intends to turn left of the vehicle1, the driver turns the steering device (steering wheel) to the left. Furthermore, when turning left of the vehicle1, the driver needs to check that there are no vehicles or other objects approaching the rear left. The driver looks at the first display132L when the vehicle1turns left. As such, the movement of the steering device is related to the movement in the gaze direction of the driver. The controller200may predict a leftward movement in the gaze direction of the driver when the steering device rotates even a little to the left. Although it is advantageous for safety to first check the side mirrors before turning the steering system, there may be cases where the driver operates the steering system first.

Furthermore, when the driver intends to turn left of the vehicle1, the driver may operate the turn indicator lever so that the turn indicator lamp instructing the left movement flashes. The driver moves his/her gaze to the side mirror to check the rear left and right sides corresponding to the direction he wants to move together with the manipulation of the direction indicator lever. As such, the flashing of the turn indicator is associated with the movement of the gaze direction of the driver. In response to flashing of the left turn indicator or the right turn indicator, the controller200may predict the movement in the gaze direction of the driver in a direction corresponding to the flashing turn indicator.

Although the left movement in the gaze direction of the driver has been described as an example in the above, the right movement in the gaze direction of the driver may also be predicted based on the driver's behavior.

The controller200may increase at least one of the frame rate of the side cameras131L and131R (131) positioned in the predicted gaze direction of the driver or the screen brightness of the displays132L and132R (132) positioned in the predicted gaze direction of the driver (in operation602). When the predicted gaze direction of the driver is a left direction, the frame rate of the first side camera131L and the screen brightness of the first display132L increase. When the predicted driving gaze direction is a right direction, the frame rate of the second side camera131R and the screen brightness of the second display132R increase.

On the other hand, because the driver's behavior related to the gaze direction of the driver has a higher correlation with a change of the traveling position, higher attention to the rear left and right sides of the vehicle1may be required. Accordingly, in response to the driver's behavior related to the gaze direction of the driver being detected, the controller200may set the frame rate of the side camera131positioned in the gaze direction of the driver and the screen brightness of the display132to the maximum.

FIG.7is a partial modified example of the method of controlling the vehicle described inFIG.4, and is a flowchart illustrating a method of controlling a vehicle linked with a guidance of a navigation system.

Referring toFIG.7, the controller200of the vehicle1may control the driver sensor140to obtain the face image of the driver, and receive the face image of the driver from the driver sensor140(in operation401). Furthermore, the controller200may control the at least one side camera131L or131R to obtain the image of the rear left and right sides of the vehicle1(in operation402). The controller200may control the at least one display132L or132R to output the image of the rear left and right sides of the vehicle1(in operation403).

The navigation system160may guide the driving route to the destination set by the driver. The navigation system160may perform a left turn guidance, a right turn guidance, or a lane change guidance based on the driving route (in operation701). The controller200may predict the gaze direction of the driver based on the left turn guidance, the right turn guidance, or the lane change guidance by the navigation system160(in operation702). The left movement in the gaze direction of the driver corresponding to the left turn guidance may be expected, and the right movement in the gaze direction of the driver corresponding to the right turn guidance may be expected. Furthermore, the left movement in the gaze direction of the driver corresponding to the left lane change guidance may be expected, and the right movement in the gaze direction of the driver corresponding to the right lane change guidance may be expected.

The controller200may increase in advance the at least one of the frame rates of the side cameras131L and131R (131) positioned in the predicted gaze direction of the driver or the screen brightness of the displays132L and132R (132) positioned in the predicted gaze direction of the driver (in operation703).

As is apparent from the above, the vehicle and the method of controlling the same of the disclosure may reduce power consumption by controlling the operation of the side camera and the display constituting the digital side mirrors.

The vehicle and the method of controlling the same of the disclosure may optimize power consumption by automatically adjusting the frame rate of the side camera and the screen brightness of the display based on the gaze direction of the driver.

Furthermore, the vehicle and the method of controlling the same of the disclosure may automatically adjust the frame rate of the side camera and the screen brightness of the display in a situation in which the driver is required to look at the digital side mirrors. Therefore, accidents may be reduced and power consumption may be optimized.

On the other hand, exemplary embodiment of the disclosures of the disclosure have thus far been described with reference to the accompanying drawings. It should be apparent to those of ordinary skill in the art that the disclosure may be practiced in other forms than the exemplary embodiment of the disclosures as described above without changing the technical idea or essential features of the disclosure. The above exemplary embodiment of the disclosures are only by way of example, and should not be interpreted in a limited sense.