Patent Description:
A vehicle is a machine which is moved by wheels and used to carry people or goods from place to place. Examples of the vehicle include two-wheeled vehicles such as motorcycles, four wheeled vehicles and trains.

For safety and convenience of vehicle users, development of technology for integrating various sensors and electronic devices into vehicles is accelerated. Particularly, vehicles are provided with various cutting-edge devices providing various functions (e.g. smart cruise control and lane keeping assistance) developed for driving convenience of users. Accordingly, self-driving in consideration of external environments by a vehicle without manipulation of a driver, that is, autonomous driving, becomes partly feasible.

ISG, one of such cutting-edge devices, restricts idling of a vehicle by automatically turning the engine off without a command from a driver when the state of the vehicle satisfies engine turn-off conditions, thereby controlling generation of exhaust gas and promoting mileage improvement. In addition, ISG automatically turns the engine on when at least one of engine turn-on conditions is satisfied while idling is restricted.

If a vehicle provided with ISG is stopped and the engine thereof is turned off, the driver or a passenger and a neighboring person or facility may be at risk. For example, the driver or passenger may attempt to exit the vehicle upon misrecognizing the state in which the engine is temporarily turned off according to turn on of ISG as a completely turned off state. In this case, ISG is turned off as a brake pedal is released and thus starting of the vehicle is automatically turned on. Accordingly, the vehicle moves forward or backward, which may cause a car crash.

Furthermore, when the driver attempts to exit the vehicle even though the gearshift of the started vehicle is not in Park (P), a dangerous situation similar to the aforementioned situation can occur.

<CIT> discloses a system with a collision determination part implemented by a pop-up hood ECU, wherein in case of a collision an automatic restart is inhibited.

<CIT> and <CIT> represent further prior art.

An object of the present invention devised to solve the problem lies in a driver assistance apparatus for improving safety of vehicle passengers by controlling a vehicle to automatically perform at least one operation for stopping the vehicle according to the state of the vehicle or conditions around the vehicle.

The present invention is defined by the independent claim. Specific embodiments are defined by the dependent claims.

The stop preparation condition may include at least one of opening of a door of a driver seat, release of a safety belt of the driver seat, opening of a trunk, opening of a hood and detection of an obstruction.

The stop preparation condition may include shifting of the gearshift to Neutral (N) or Reverse (R) on an uphill road or shifting of the gearshift to Neutral (N) or Drive (D) on a downhill road. The stop execution condition may include release of the brake pedal.

The processor may control braking power according to the electronic parking brake or the foot brake on the basis of the gradient of the uphill road or the downhill road.

The stop preparation condition may include un-release of the brake pedal from the last time the vehicle stopped, and the stop execution condition may include continuous traveling of the vehicle at a predetermined speed or higher for a predetermined distance or longer.

The processor may perform the predetermined operation on the basis of whether an object caught in an open door of the vehicle is detected. The driving information may include a torque value measured by a torque sensor corresponding to the open door, and the processor may detect the object caught in the open door on the basis of the torque value.

The processor may determine whether a passenger exits the vehicle on the basis of whether each door of the vehicle is open. When the trunk of the vehicle is open, the gearshift is shifted to Reverse (R) and the passenger exits the car, the processor may perform the predetermined operation when an object moving behind the vehicle is detected.

When the trunk of the vehicle is open on an uphill road, the gearshift is shifted to Neutral (N) and the passenger exits the vehicle, the processor may perform the predetermined operation if the brake pedal is released when the object moving behind the vehicle is detected.

The interface may receive sensing information from at least one sensor provided to the rear side of the vehicle. The processor may detect the object moving behind the vehicle on the basis of the sensing information.

The interface may receive an outdoor image provided by a camera included in the vehicle. The processor may detect at least one object from the outdoor image and perform the predetermined operation on the basis of object information on the detected object. The object information may include at least one of the type, position, speed, shape and size of the detected object.

When the detected object includes an obstruction, the processor may perform the predetermined operation on the basis of a relative position of the obstruction with respect to the vehicle, wherein the obstruction corresponds to at least one of another vehicle, a pedestrian, a tree, a fallen object and a structure.

The processor may perform the predetermined operation when the obstruction is located within a predetermined distance from the front side of the vehicle and the gearshift is shifted to Drive (D).

The processor may perform the predetermined operation when the obstruction is located within a predetermined distance from the rear side of the vehicle and the gearshift is shifted to Reverse (R).

The driving information may include information on whether each door of the vehicle is open and an opening angle of an open door. When one of doors of the vehicle is open and the obstruction is located at the side of the open door, the processor may perform the predetermined operation on the basis of an opening angle of the open door.

The driving information may include information on whether each window of the vehicle is open. When one of windows of the vehicle is open, the obstruction is located at the side of the open window and the detected object includes a part of the body of a passenger, protruding from the open window, the processor may perform the predetermined operation on the basis of a protruding length of the part of the body of the passenger.

The processor may stop execution of the predetermined operation when the part of the body of the passenger moves inside the open window.

The processor may provide a message about the predetermined operation through an output device included in the vehicle when the predetermined operation is performed.

Details of other embodiments are included in the detailed description and drawings.

According to at least one embodiment of the present invention, when a vehicle provided with ISG is stopped, a predetermined operation can be automatically performed such that the stopped state of the vehicle is maintained according to vehicle driving information, thereby reducing risk of collision with a passenger, a neighboring person or facility. For example, the vehicle can be controlled to maintain the stopped state at least temporarily by automatically executing at least one of an operation of blocking turn off of ISG, an operation of turning off the engine of the vehicle, an operation of activating an electronic parking brake (EPB) and an operation of activating a foot brake on the basis of states of a door, a safety belt, the brake pedal, the trunk and the hood of the vehicle.

In addition, a predetermined operation can be selectively performed such that the stopped state of the vehicle is maintained according to a gearshift position of the vehicle and a slope direction of a road surface (i.e. uphill or downhill).

Furthermore, braking power of the vehicle can be differentially controlled according to the gradient of a road surface.

Moreover, a predetermined operation can be selectively performed on the basis of the position of an obstruction according to a gearshift position of the vehicle.

In addition, when the vehicle is in a crash accident while stopped, a predetermined operation can be automatically performed such that the stopped state of the vehicle is maintained according to whether the brake pedal is released.

The effects of the present invention are not limited to the above-described effects and other effects which are not described herein will become apparent to those skilled in the art from the following description.

The present invention will now be described in more detail with reference to the attached drawings. The same reference numbers will be used throughout this specification to refer to the same or like parts. The terms "module" and "unit" used to signify components are used herein to aid in understanding of the components and thus they should not be considered as having specific meanings or roles. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may obscure the subject matter of the present invention. The accompanying drawings illustrate exemplary embodiments of the present invention and provide a more detailed description of the present invention. However, the scope of the present invention should not be limited thereto. It should be understood that there is no intent to limit the invention to the particular forms disclosed herein. On the contrary, the invention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the claims.

Although terms including an ordinal number, such as first or second, may be used to describe a variety of constituent elements, the constituent elements are not limited to the terms, and the terms are used only for the purpose of discriminating one constituent element from other constituent elements.

It will be understood that when an element is "connected" or "coupled" to another element in the following description, it can be directly connected or coupled to the other element or intervening elements may be present therebetween. In contrast, when an element is "directly connected" or "directly coupled" to another element, there are no intervening elements present.

The singular forms are intended to include the plural forms as well, unless context clearly indicates otherwise.

It will be further understood that the terms "include" or "have" when used in this specification, specify the presence of stated features, numerals, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, numerals, steps, operations, elements, components, and/or groups thereof.

A vehicle described in the specification may include a car and a motorcycle. The car is described as the vehicle in the following.

The vehicle described in the specification may include an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source and an electric vehicle having an electric motor as a power source.

<FIG> is a block diagram of a vehicle <NUM> related to the present invention.

The vehicle <NUM> may include a communication unit <NUM>, an input unit <NUM>, a memory <NUM>, an output unit <NUM>, a vehicle driving unit <NUM>, a sensing unit <NUM>, a controller <NUM>, an interface <NUM> and a power supply unit <NUM>.

The communication unit <NUM> may include one or more modules for enabling wireless communication between the vehicle <NUM> and external devices (e.g. a mobile terminal, an external server and another vehicle). In addition, the communication unit <NUM> may include one or more modules for linking the vehicle <NUM> to one or more networks.

The communication unit <NUM> may include a broadcast reception module <NUM>, a wireless Internet module <NUM>, a short-range communication module <NUM>, a position information module <NUM> and an optical communication module <NUM>.

The broadcast reception module <NUM> receives broadcast signals or broadcast related information from an external broadcast management server through broadcast channels. Here, broadcast includes radio broadcast and TV broadcast.

The wireless Internet module <NUM> refers to a module for wireless Internet access and may be embedded in the vehicle <NUM> or provided to the outside of the vehicle <NUM>. The wireless Internet module <NUM> is configured to transmit and receive radio signals in communication networks according to wireless Internet technologies.

The wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced) and the like, and the wireless Internet module <NUM> transmits and receives data according to at least one of wireless Internet technologies including those not above-mentioned. For example, the wireless Internet module <NUM> can wirelessly exchange data with an external server. The wireless Internet module <NUM> can receive weather information and traffic information (e.g., TPEG (Transport Protocol Expert Group) information) from the external server.

The short-range communication module <NUM> is a module for short range communication and can support short range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct and Wireless USB (Wireless Universal Serial Bus).

The short-range communication module <NUM> can perform short-range communication between the vehicle <NUM> and at least one external device by establishing wireless area networks. For example, the short-range communication module <NUM> can exchange data with a mobile terminal of a passenger of the vehicle. The short-range communication module <NUM> can receive weather information and traffic information (e.g., TPEG information) from a mobile terminal or an external server. When the user gets in the vehicle <NUM>, the mobile terminal of the user and the vehicle <NUM> can be paired automatically or according to execution of an application by the user.

The position information module <NUM> is a module for locating the vehicle <NUM> and a typical example thereof is a GPS (Global Positioning System) module. For example, the vehicle can acquire the location thereof using signals sent from a GPS satellite using the GPS module.

The optical communication module <NUM> may include a light transmission unit and a light receiving unit.

The light receiving unit converts a light signal into an electrical signal so as to receive information. The light receiving unit may include a photodiode (PD) for receiving light. The photodiode converts light into an electrical signal. For example, the light receiving unit can receive information on a preceding vehicle through light emitted from a light source included in the preceding vehicle.

The light transmission unit may include at least one light-emitting element for converting an electrical signal into a light signal. Here, the light-emitting element is preferably an LED (Light Emitting Diode). The light transmission unit converts an electrical signal into a light signal and emits the light signal. For example, the light transmission unit can emit a light signal through flickering of the light-emitting element, which corresponds to a predetermined frequency. According to an embodiment, the light transmission unit may include a plurality of light-emitting element arrays. According to an embodiment, the light transmission unit may be integrated with a lamp provided to the vehicle <NUM>. For example, the light transmission unit can be at least one of a headlight, a taillight, a brake light, a turn signal lamp and a sidelight. For example, the optical transmission module <NUM> can exchange data with another vehicle through optical communication.

The input unit <NUM> may include an operation means <NUM>, a microphone <NUM> and a user input unit <NUM>.

The operation means <NUM> receives user input for driving the vehicle <NUM>. The operation means <NUM> may include a steering input means, a shift input means, an acceleration input means and a brake input means. The user applies steering input to the steering input means. The steering input means may include a steering wheel. According to an embodiment, the steering input means may be configured in the form of a touchscreen, a touch pad or a button.

The user applies inputs with respect to park (P), drive (D), neutral (N), reverse (R) of the vehicle <NUM> through the shift input means. The shift input means is preferably configured in the form of a lever. According to an embodiment, the shift input means may be configured in the form of a touchscreen, a touch pad or a button.

The user applies input with respect to acceleration of the vehicle <NUM> through the acceleration input means. The user applies input with respect to reduction of the speed of the vehicle <NUM> to the brake input means. The acceleration input means and the brake input means are preferably configured in the form of a pedal. According to an embodiment, the acceleration input means or the brake input means may be configured in the form of a touchscreen, a touch pad or a button.

A camera <NUM> is provided to one side of the interior of the vehicle <NUM> so as to photograph an indoor image of the vehicle <NUM>. For example, the camera <NUM> can be provided to various portions of the vehicle <NUM>, such as the surface of the dashboard, the surface of the roof and the rear view mirror, so as to photograph a passenger in the vehicle <NUM>. In this case, the camera <NUM> can generate an indoor image of a region including the driver seat of the vehicle <NUM>. In addition, the camera <NUM> can generate an indoor image of a region including the driver seat and passenger seat. An indoor image generated by the camera <NUM> may be a <NUM>-dimensional image and/or <NUM>-dimensional image. To generate a 3D image, the camera <NUM> may include at least one of a stereo camera, a depth camera and a 3D laser scanner. The camera <NUM> can provide the indoor image to the controller <NUM> functionally coupled thereto.

The controller <NUM> may detect objects by analyzing the indoor image provided by the camera <NUM>. For example, the controller <NUM> can detect a gaze and/or a gesture of the driver from a part of the indoor image, which corresponds to the driver seat area. As another example, the controller <NUM> can detect a gaze and/or a gesture of a passenger from a part of the indoor image, which corresponds to an indoor region other than the driver seat area. The gazes and/or gestures of the driver and the passenger may be detected simultaneously or independently.

The microphone <NUM> may process an external audio signal into electrical data. The processed data may be used in various manners according to functions executed in the vehicle <NUM>. The microphone <NUM> may convert a voice command of the user into electrical data. The converted electrical data may be transmitted to the controller <NUM>.

According to an embodiment, the camera <NUM> or the microphone <NUM> may be included in the sensing unit <NUM> instead of the input unit <NUM>.

The user input unit <NUM> is used to receive information from the user. Upon input of information through the user input unit <NUM>, the controller <NUM> may control operation of the vehicle <NUM> to respond to the input information. The user input unit <NUM> may include a touch type input means or a mechanical input means. According to an embodiment, the user input unit <NUM> may be provided to a region of the steering wheel of the vehicle. In this case, the driver can operate the user input unit <NUM> with a finger while gripping the steering wheel.

The input unit <NUM> may include a plurality of buttons or a touch sensor. Various inputs can be input through the plurality of buttons or touch sensor.

The sensing unit <NUM> senses signals related to driving of the vehicle <NUM>. To this end, the sensing unit <NUM> may include a collision sensor, a wheel sensor, a speed sensor, a tilt sensor, a weight sensor, a heading sensor, a yaw sensor, a gyro sensor, a position sensor, a front side/rear side sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor, a vehicle internal temperature sensor, a vehicle internal humidity sensor, an infrared sensor, radar <NUM>, lidar <NUM> and an ultrasonic sensor <NUM>.

Accordingly, the sensing unit <NUM> may acquire sensing signals with respect to vehicle collision information, vehicle direction information, vehicle position information (GPS information), heading information, speed information, acceleration information, vehicle tilt information, driving/reversing information, battery information, fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle information and the like. The controller <NUM> may generate control signals for acceleration, deceleration and heading of the vehicle <NUM> on the basis of external environment information acquired through at least one of the camera, ultrasonic sensor, infrared sensor, radar and lidar included in the vehicle <NUM>. Here, the external environment information may be information related to objects located within a predetermined range from the vehicle <NUM> which is being driven. For example, the external environment information can include information about the number of obstructions located within <NUM> of the vehicle <NUM>, distances between the obstructions and the vehicle <NUM>, and sizes and types of the obstructions.

In addition, the sensing unit <NUM> may further include an acceleration pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an air temperature sensor (ATS), a water temperature sensor (WTS), a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS) and the like.

Furthermore, the sensing unit <NUM> may include a biometric information sensor. The biometric information sensor senses and acquires biometric information of a person getting in the car. The biometric information may include fingerprint information, iris-scan information, retina-scan information, hand geometry information, facial recognition information and voice recognition information. The biometric information sensor may include a sensor for sensing biometric information of the person getting in the vehicle. Here, the camera <NUM> and the microphone <NUM> can operate as a sensor. The biometric information sensor can acquire information on a hand and face recognition information through the camera <NUM>.

The sensing unit <NUM> may include at least one camera <NUM> for photographing the outside of the vehicle <NUM>. The camera <NUM> can be called an external camera. For example, the sensing unit <NUM> can include a plurality of cameras <NUM> provided to different points of the exterior of the vehicle <NUM>. The camera <NUM> may include an image sensor and an image processing module. The camera <NUM> can process a still image or video acquired through the image sensor (e.g. CMOS or CCD). The image processing module can process the still image or video acquired through the image sensor to extract necessary information and transfer the extracted information to the controller <NUM>.

The camera <NUM> can include an image sensor (e.g. CMOS or CCD) and an image processing module. In addition, the camera <NUM> can process a still image or video acquired through the image sensor. The image processing module can process the still image or video acquired through the image sensor. Furthermore, the camera <NUM> can acquire an image including at least one of a traffic light, a traffic sign, a pedestrian, another vehicle and a road.

The output unit <NUM> outputs information processed in the controller <NUM> and may include a display unit <NUM>, an audio output unit <NUM> and a haptic output unit <NUM>.

The display unit <NUM> may display information processed in the controller <NUM>. For example, the display <NUM> can display vehicle related information. The vehicle related information may include vehicle control information for direct control of the vehicle or vehicle driving assistance information for providing driving guidance to the vehicle driver. In addition, the vehicle related information may include vehicle state information indicating the current state of the vehicle or vehicle driving information related to driving of the vehicle <NUM>.

The display unit <NUM> may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display and an e-ink display.

The display unit <NUM> may implement a touchscreen by forming a layered structure with a touch sensor or by being integrated with the touch sensor. Such touchscreen can function as the user input unit <NUM> that provides an input interface between the vehicle <NUM> and the user and, simultaneously, provide an output interface between the vehicle <NUM> and the user. In this case, the display <NUM> may include a touch sensor for sensing touch applied to the display unit <NUM> such that a control command is input to the display unit <NUM> through touch. When touch is applied to the display unit <NUM>, the touch sensor can sense the touch and the controller <NUM> can generate a control command corresponding to the touch on the basis of the sensed touch. Input applied through touch may be text, figures or menu items that can be indicated or designated in various modes.

The display unit <NUM> may include a cluster to enable the driver to drive the vehicle and, simultaneously, to check vehicle state information or vehicle driving information. The cluster may be provided on the dashboard. In this case, the driver can check information displayed on the cluster while looking forward.

According to an embodiment, the display unit <NUM> may be implemented as an HUD (Head Up Display). When the display <NUM> is implemented as an HUD, information can be output through a transparent display provided to the windshield of the vehicle. Alternatively, the display unit <NUM> may include a projection module so as to output information through an image projected to the windshield.

The audio output unit <NUM> converts an electrical signal from the controller <NUM> into an audio signal and outputs the audio signal. To this end, the audio output unit <NUM> may include a speaker. The audio output unit <NUM> can output sound corresponding to operation of the user input unit <NUM>.

The haptic output unit <NUM> generates haptic output. For example, the haptic output unit <NUM> can vibrate the steering wheel, a seat belt or a seat to enable the user to recognize haptic output.

The vehicle driving unit <NUM> may control operations of various apparatuses of the vehicle. The vehicle driving unit <NUM> may include a power source driver <NUM>, a steering driver <NUM>, a brake driver <NUM>, a lamp driver <NUM>, an air-conditioner driver <NUM>, a window driver <NUM>, an airbag driver <NUM>, a sunroof driver <NUM> and a wiper driver <NUM>.

The power source driver <NUM> can perform electronic control of a power source of the vehicle <NUM>. The power source driver <NUM> may include an accelerator for increasing the speed of the vehicle <NUM> and a brake for decreasing the speed of the vehicle <NUM>.

For example, when the power source is a fossil fuel (e.g. gasoline or diesel) based engine (not shown), the power source driver <NUM> can perform electronic control of the engine so as to control the output torque and revolutions per minute (RPM) of the engine. When the power source driver <NUM> is an engine, the speed of the vehicle can be limited by restricting an engine output torque under the control of the controller <NUM>.

Alternatively, when an electric motor (not shown) is a power source, the power source driver <NUM> can control the motor. Accordingly, revolutions per minute (RPM), torque and the like of the motor can be controlled.

When the vehicle <NUM> is a hybrid car, both the engine and the motor can be configured as a power source.

The steering driver <NUM> may include a steering apparatus. The steering driver <NUM> may electronically control the steering apparatus of the vehicle <NUM>. For example, the steering driver <NUM> can include a steering torque sensor, a steering angle sensor and a steering motor. The steering toque sensor can sense a steering torque applied by the driver to the steering wheel. The steering driver <NUM> can control a steering torque and a steering angle by changing the magnitude and direction of current applied to the steering motor on the basis of the speed and steering torque of the vehicle <NUM>. In addition, the steering driver <NUM> can determine whether the vehicle <NUM> is correctly steered on the basis of steering angle information acquired through the steering angle sensor. In this manner, heading of the vehicle can be changed. In addition, the steering driver <NUM> can reduce the weight of the steering wheel by increasing the steering torque of the steering motor when the vehicle <NUM> travels at a low speed and increase the weight of the steering wheel by decreasing the steering torque of the steering motor when the vehicle <NUM> travels at a high speed. When an autonomous driving function of the vehicle <NUM> is executed, the steering driver <NUM> may control the steering motor to generate an appropriate steering torque on the basis of a sensing signal output from the sensing unit <NUM> or a control signal provided by the controller <NUM>, even when the driver doesn't operate the steering wheel (e.g. when steering torque is not sensed).

The brake driver <NUM> may electronically control a brake apparatus of the vehicle <NUM>. For example, the brake driver <NUM> can reduce the speed of the vehicle <NUM> by controlling the operation of a brake provided to the wheels. As another example, the brake driver <NUM> can adjust the direction of the vehicle <NUM> to the left or right by differently operating brakes respectively provided to the left and right wheels.

The lamp driver <NUM> may turn on/turn off lamps provided to the inside and outside of the vehicle <NUM>. The lamp driver <NUM> may include a lighting apparatus. In addition, the lamp driver <NUM> may control illuminance, directions and the like of lamps included in the lighting apparatus. For example, the lamp driver <NUM> can control the turn signal, head lamp, brake lamp and the like.

The air-conditioner driver <NUM> may electronically control an air conditioner of the vehicle <NUM>. For example, the air-conditioner driver <NUM> can control the air conditioner to supply chilly air to the inside of the vehicle <NUM> when the internal temperature of the vehicle is high.

The window driver <NUM> may electronically control a window apparatus of the vehicle <NUM>. For example, the window driver <NUM> can control opening or closing of left and right windows provided to the side of the vehicle.

The airbag driver <NUM> may electronically control an airbag apparatus provided to the inside of the vehicle <NUM>. For example, the airbag driver <NUM> can control the airbag apparatus to operate in a dangerous situation.

The sunroof driver <NUM> may electronically control a sunroof apparatus of the vehicle <NUM>. For example, the sunroof driver <NUM> can control opening or closing of a sunroof.

The wiper driver <NUM> can electronically control wipers of the vehicle <NUM>. For example, the wiper driver <NUM> can control the number of times of driving the wipers 14a and 14b, a wiper driving speed and the like according to user input upon reception of user input that instructs the wiper driver <NUM> to drive the wipers through the user input unit <NUM>. As another example, the wiper driver <NUM> can automatically drive the wipers 14a and 14b without user input by determining the quantity or intensity of rainwater on the basis of a sensing signal of a rain sensor included in the sensing unit <NUM>.

The vehicle driving unit <NUM> may further include a suspension driver (not shown). The suspension driver may electronically control a suspension apparatus of the vehicle <NUM>. For example, the suspension driver can reduce vibration of the vehicle <NUM> by controlling the suspension apparatus when the surface of the road is rough.

The memory <NUM> is electrically connected to the controller <NUM>. The memory <NUM> may store fundamental data about the units, control data for operation control of the units and input/output data. The memory <NUM> may be various types of storage devices such as a ROM, a RAM, an EPROM, a flash drive and a hard drive. The memory <NUM> may store various types of data for overall operation of the vehicle <NUM>, such as programs for processing or control.

The interface <NUM> may function as a passage to various external devices connected to the vehicle <NUM>. For example, the interface <NUM> can include a port that can be connected to a mobile terminal and be connected to the mobile terminal via the port. In this case, the interface <NUM> can exchange data with the mobile terminal.

The interface <NUM> may receive turn signal information. The turn signal information may be a turn-on signal of a turn signal for left turn or right turn, input by the user. When left or right turn signal turn-on input is received through the user input unit <NUM> of the vehicle <NUM>, the interface <NUM> can receive left or right turn signal information.

The interface <NUM> may receive vehicle speed information, steering wheel rotation angle information or gearshift information. The interface <NUM> may receive vehicle speed information, steering wheel rotation angle information or gearshift information, sensed through the sensing unit <NUM> of the vehicle <NUM>. The interface <NUM> may receive vehicle speed information, steering wheel rotation angle information or gearshift information from the controller <NUM> or the sensing unit <NUM> of the vehicle.

The gearshift information may be information about the position of the gearshift of the vehicle. For example, the gearshift information can be information about the position of the gearshift which corresponds to park P, reverse R, neutral N or drive D.

The interface <NUM> may receive user input applied through the user input unit <NUM> of the vehicle <NUM>. The interface <NUM> may receive user input from the input unit <NUM> of the vehicle <NUM> or through the controller <NUM>.

The interface <NUM> may receive information acquired from an external device. For example, when traffic light change information is received from an external server through the communication unit <NUM> of the vehicle <NUM>, the interface <NUM> can receive the traffic light change information from the controller <NUM>.

The controller <NUM> may control operations of the respective units of the vehicle <NUM>. The controller <NUM> may be called an ECU (Electronic Control Unit).

The controller <NUM> may be implemented using at least one of ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors, controllers, micro-controllers, microprocessors) and other electrical units for executing the corresponding functions.

The power supply unit <NUM> may supply power necessary for operations of the respective components under the control of the controller <NUM>. Particularly, the power supply unit <NUM> may be provided with power from a battery (not shown) inside the vehicle <NUM>.

An audio video navigation (AVN) apparatus of the vehicle <NUM> may exchange data with the controller <NUM>. The controller <NUM> may receive navigation information from the AVN apparatus. The navigation information may include information on a set destination, route information depending on the destination, map information regarding vehicle driving and vehicle location information.

Some components shown in <FIG> may not be mandatory to implement the vehicle <NUM>. Accordingly, the vehicle <NUM> may include more or fewer components than the aforementioned components. At least one of the components shown in <FIG> may be replaced by another component.

<FIG> shows the appearance of the vehicle <NUM> of <FIG>, viewed from various directions. For convenience of description, the vehicle <NUM> is assumed to be a four-wheeled car.

Referring to <FIG>, the vehicle <NUM> may include tires 11a, 11b, 11c and 11d which rotate by a power source, a steering wheel <NUM> for steering the vehicle <NUM>, headlights 13a and 13b, a hood <NUM>, a trunk <NUM>, doors <NUM> and a window <NUM>. The window <NUM> may be provided per door <NUM>. The window <NUM> may be an electronically driven power window.

The overall height H of the vehicle <NUM>, which is a length between the ground plane and the highest point of the body of the vehicle <NUM>, may be changed within a predetermined range according to the weight or position of a passenger or load of the vehicle <NUM>. The lowest point of the body of the vehicle <NUM> may be separated from the ground by a minimum ground clearance G. Accordingly, the body of the vehicle <NUM> can be prevented from being damaged by an object lower than the minimum ground clearance G.

It is assumed that the distance between the front left and right tires 11a and 11b equals the distance between the rear left and right tires 11c and 11d. In the following description, it is assumed that the distance between the inside of the front left tire 11a and the inside of the front right tire 11b and the distance between the inside of the rear left tire 11c and the inside of the rear right tire 11d have the same value T.

The overall width O of the vehicle <NUM> can be defined as a maximum distance between the left end and the right end of the body of the vehicle <NUM>, except for side-view mirrors (e.g. electric folding type side-view mirrors).

A camera <NUM> separate from the camera <NUM> shown in <FIG> may be provided to one side of the windshield of the vehicle <NUM>. The camera <NUM> may be a stereo camera that provides 3D data about a front view image in a wider range than that provided by a camera 161a of <FIG> and may be included in the sensing unit <NUM>.

The controller <NUM> of the vehicle <NUM> or a processor of a driver assistance apparatus may acquire information about an external environment of the vehicle <NUM> on the basis of a front view image provided by the camera <NUM>. For example, the information about the external environment can include data about objects (e.g., a pedestrian, a traffic light, an opposite vehicle and wall) located within the photographing range of the camera <NUM>.

In this case, the controller <NUM> of the vehicle <NUM> or the processor of the driver assistance apparatus can output a control signal for performing at least one predetermined operation to the driving unit <NUM> on the basis of the information about the external environment. For example, the controller <NUM> of the vehicle <NUM> or the processor of the driver assistance apparatus can control at least one of starting state, steering, acceleration, braking and lighting of the vehicle <NUM>.

<FIG> is a top view of the vehicle <NUM> aforementioned with reference to <FIG>.

Referring to <FIG>, at least one radar <NUM>, at least one lidar <NUM> and at least one ultrasonic sensor <NUM> may be provided to various portions of the body of the vehicle <NUM>, as described above with reference to <FIG>.

Specifically, the radar <NUM> may be provided to one side of the vehicle <NUM> so as to transmit electromagnetic waves to surroundings and to receive electromagnetic waves reflected from objects present around the vehicle <NUM>. For example, the radar <NUM> can acquire information about a distance, direction and height of an object by measuring propagation time of electromagnetic waves reflected by the object.

The lidar <NUM> can be provided to one side of the vehicle <NUM> so as to emit laser to surroundings of the vehicle <NUM>. The laser emitted from the lidar <NUM> can be scattered or reflected to return to the vehicle <NUM> and the lidar <NUM> can acquire information about physical characteristics of a target located around the vehicle, such as distance, speed and shape, on the basis of time taken for the laser to return, intensity of the laser, frequency variation and polarization state change.

The ultrasonic sensor <NUM> is provided to one side of the vehicle <NUM> so as to generate ultrasonic waves toward surroundings of the vehicle <NUM>. Ultrasonic waves generated by the ultrasonic sensor <NUM> have a high frequency (about <NUM> or higher) and short wavelength. Such ultrasonic sensor <NUM> can be used to recognize an object close to the vehicle <NUM>.

According to an embodiment, different numbers of radars <NUM>, lidars <NUM> and ultrasonic sensors <NUM> may be provided to positions different from those shown in <FIG>. The vehicle <NUM> may not include at least one of the radar <NUM>, lidar <NUM> and ultrasonic sensor <NUM>.

<FIG> shows a plurality of cameras provided to different portions of the vehicle <NUM>. For convenience of description, it is assumed that four cameras 161a, 161b, 161c and 161d are provided.

In this case, the four cameras 161a, 161b, 161c and 161d may be identical to the aforementioned camera <NUM>.

Referring to <FIG>, the cameras 161a, 161b, 161c and 161d may be respectively provided to the front, left, right and rear sides of the vehicle <NUM>. The cameras 161a, 161b, 161c and 161d may be included in the camera <NUM> shown in <FIG>.

The front camera 161a may be disposed near the windshield, emblem or radiator grill of the vehicle.

The left camera 161b may be disposed inside of the case of the left side-view mirror. Alternatively, the left camera 161b may be provided outside of the case of the left side-view mirror. Furthermore, the left camera 161b may be provided to a region of the outside of the left front door, left rear door or left fender.

The right camera 161c may be disposed inside of the case of the right side-view mirror. Alternatively, the left camera 161c may be provided outside of the case of the right side-view mirror of the vehicle. Furthermore, the left camera 161c may be provided to a region of the outside of the right front door, right rear door or right fender of the vehicle.

The rear camera 161d may be disposed near the rear license plate or trunk switch of the vehicle.

Images respectively photographed by the cameras 161a, 161b, 161c and 161d are transmitted to the controller <NUM>, and the controller <NUM> can generate an around view image of the vehicle <NUM> by combining the images.

While <FIG> shows the four cameras provided to the exterior of the vehicle <NUM>, the number of cameras is not limited thereto and more or fewer cameras may be provided to portions different from those shown in <FIG>.

<FIG> shows an exemplary omnidirectional synthesized around view image <NUM> of the vehicle <NUM>.

Referring to <FIG>, the image <NUM> may include a first image region <NUM> corresponding to an outdoor image photographed by the front camera 161a, a second image region <NUM> corresponding to an outdoor image photographed by the left camera 161b, a third image region <NUM> corresponding to an outdoor image photographed by the right camera 161c and a fourth image region <NUM> corresponding to an outdoor image photographed by the rear camera 161d. The image <NUM> may be called an around view monitoring image.

When the image <NUM> is generated, boundaries <NUM>, <NUM>, <NUM> and <NUM> between outdoor images included in the image <NUM> are generated. The controller <NUM> can display a seamless image by image-blending the boundaries.

The boundaries <NUM>, <NUM>, <NUM> and <NUM> between images may be displayed. In addition, the image <NUM> may include a predetermined image representing the vehicle <NUM> at the center thereof.

The controller <NUM> can display the image <NUM> on a display device provided to the inside of the vehicle <NUM>.

<FIG> shows an exemplary structure of the camera module <NUM> provided to the windshield shown in <FIG>.

Referring to <FIG>, the camera module <NUM> may include a first camera 195a and a second camera 195b. The second camera 195b may be separated from the first camera <NUM> by a predetermined distance. In this case, the camera module <NUM> may be called a stereo camera and images acquired by the first camera 195a and the second camera 195b may be called stereo images.

Specifically, the first camera 195a may include a first image sensor and a first lens 193a. The second camera 195b may include a second image sensor and a second lens 193b. The first and second image sensors may be CCDs or CMOS sensors.

The camera module <NUM> may further include a first light shield 192a and a second light shield 192b for respectively shielding part of light input to the first lens 193a and the second lens 193b.

The camera module <NUM> may be configured such that the camera module <NUM> can be attached to/detached from the inside of the windshield of the vehicle <NUM>.

The camera module <NUM> can acquire an around view of the vehicle. For example, the camera module <NUM> can acquire a front view image of the vehicle. The image acquired through the camera module <NUM> can be transmitted to the controller <NUM> or the driver assistance apparatus.

The driver assistance apparatus, which will be described later, may detect disparity of stereo images provided by the first and second cameras 195a and 195b and detect at least one object located in front of the vehicle <NUM> on the basis of the disparity. When an object is detected from the stereo images, the driver assistance apparatus can track the detected object continuously or periodically in order to determine movement trajectory of the object.

<FIG> and <FIG> show the passenger compartment of the vehicle <NUM>, viewed from different directions.

Specifically, <FIG> shows the passenger compartment when viewed from the rear side and <FIG> shows the driver seat when viewed from the side.

Referring to <FIG> and <FIG>, the passenger compartment of the vehicle <NUM> may be provided with an AVN apparatus <NUM>, the steering wheel <NUM>, the doors <NUM>, seats <NUM>, a brake pedal <NUM>, an accelerator pedal <NUM>, a foot brake <NUM>, a gearshift <NUM>, a safety belt <NUM> and an input switch 121a. The input switch 121a may be an input means included in the input unit <NUM> shown in <FIG>. For example, the input switch 121a can be configured in the form of an array of a trunk opening/closing switch, a hood opening/closing switch and a fuel inlet opening/closing switch.

The AVN apparatus <NUM> may be provided to the center fascia corresponding to the center of the front side of the passenger compartment. In this case, the AVN apparatus <NUM> can display images showing execution states of various functions related to the vehicle <NUM> and guiding specific information requested by a passenger, such as audio screen, video screen, navigation screen, air-conditioner setting screen and around view images. The AVN apparatus <NUM> can output an audio message simultaneously with or separately from image display. The passenger can operate the AVN apparatus <NUM> through a key, a touch pad, a jog dial or the like, which is electrically connected to the AVN apparatus <NUM>.

The sensing unit <NUM> may be electrically connected to the steering wheel <NUM>, doors <NUM>, seats <NUM>, brake pedal <NUM>, accelerator pedal <NUM>, foot brake <NUM>, gearshift <NUM> and safety belt <NUM> so as to sense states thereof. For example, the sensing unit <NUM> can sense a rotating direction and angle of the steering wheel <NUM> and sense whether the brake pedal <NUM> or the accelerator pedal <NUM> has been pushed by the driver. In addition, the sensing unit <NUM> can sense the position of the gearshift <NUM> as P/R/N/D, and sense whether the safety belt <NUM> of each seat <NUM> is fastened or released.

Signals or information indicating states of the steering wheel <NUM>, doors <NUM>, seats <NUM>, brake pedal <NUM>, accelerator pedal <NUM>, foot brake <NUM>, gearshift <NUM> and safety belt <NUM>, sensed by the sensing unit <NUM>, may be provided to an interface <NUM> of the driver assistance apparatus, which will be described later, through wired or wireless communication.

<FIG> is a block diagram of a driver assistance apparatus <NUM> according to an embodiment of the present invention.

Referring to <FIG>, the driver assistance apparatus <NUM> may include an interface <NUM>, a memory <NUM> and a processor <NUM>. In this case, the memory <NUM> may be integrated into the processor <NUM>. The driver assistance apparatus may further include a communication unit <NUM>, an input unit <NUM> or an output unit <NUM>.

The interface <NUM> can receive vehicle related data or transmit signals processed or generated by the processor to the outside. To this end, the interface <NUM> can perform data communication with the controller <NUM> and the sensing unit <NUM> of the vehicle according to a wired or wireless communication scheme.

The interface <NUM> can receive navigation information through data communication with the controller <NUM> or the AVN apparatus <NUM>. Here, the navigation information may include information on a set destination, information on a route according to the destination, map information related to vehicle driving and information on the current location of the vehicle. In addition, the navigation information may include information on the location of the vehicle on a road.

The interface <NUM> can receive sensor information from the controller <NUM> or the sensing unit <NUM>. Here, the sensor information may include at least one of vehicle direction information, vehicle position information (GPS information), heading information, speed information, acceleration information, vehicle tilt information, drive/reverse information, battery information, fuel information, tire information, vehicle lamp information, vehicle internal temperature information and vehicle internal humidity information.

Such sensor information may be acquired from a heading sensor, a yaw sensor, a gyro sensor, a position sensor, a front-side/rear-side sensor, a wheel sensor, a vehicle speed sensor, a vehicle tilt sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor according to steering wheel rotation, a vehicle internal temperature sensor, a vehicle internal humidity sensor and the like.

From among sensor information, information related to a driving state of the vehicle <NUM> may be referred to as "driving information". For example, the driving information may include vehicle direction information, vehicle position information, heading information, speed information, vehicle tilt information, door opening information, brake pedal information, safety belt information, hood information, trunk information, ISG operation information, impact information, obstruction information and the like.

The interface <NUM> can receive turn signal information. The turn signal information may be a turn-on signal of a turn signal for left turn or right turn, input by the user. When left or right turn signal turn-on input is received through the user input unit (<NUM> of <FIG>) of the vehicle <NUM>, the interface <NUM> can receive left or right turn signal information.

The interface <NUM> may receive vehicle speed information, steering wheel rotation angle information or gearshift information. The interface <NUM> may receive vehicle speed information, steering wheel rotation angle information or gearshift information, sensed through the sensing unit <NUM> of the vehicle <NUM>. Here, the gearshift information may be information about the position of the gearshift of the vehicle. For example, the gearshift information can be information about the position of the gearshift which corresponds to Park (P), Reverse (R), Neutral (N), Drive (D) or one of first to multi-stage gear states.

The memory <NUM> may store various types of data for overall operation of the driver assistance apparatus, such as programs for processing or control of the processor <NUM>. The memory <NUM> may be an information recording medium such as a ROM, RAM, EPROM, flash drive and hard drive.

The memory <NUM> may store data for verifying an object. For example, the memory <NUM> can store data for verifying an object according to a predetermined algorithm when the object is detected from an image acquired through the camera <NUM>.

The memory <NUM> may store data about traffic information. For example, the memory <NUM> can store data for verifying traffic information according to a predetermined algorithm when the traffic information is detected from an image acquired through the camera <NUM>.

The communication unit <NUM> can wirelessly exchange data with a mobile terminal or a server. Particularly, the communication unit <NUM> can exchange data with a mobile terminal of the vehicle driver according to a wireless communication scheme. Wireless data communication schemes may include Bluetooth, Wi-Fi Direct, Wi-Fi, APiX and NFC.

The communication unit <NUM> can receive weather information and traffic information, for example, TPEG (Transport Protocol Expert Group) information from the mobile terminal or the server. When the user rides in the vehicle, the mobile terminal of the user and the driver assistance apparatus can be paired automatically or according to execution of an application by the user.

The communication unit <NUM> may receive traffic light change information from an external server. Here, the external server may be a server located in a traffic control center.

The input unit <NUM> may include a plurality of buttons or a touchscreen. The user can turn on/off the driver assistance apparatus by manipulating the buttons or the touchscreen. In addition, various input operations can be performed.

The output unit <NUM> outputs information corresponding to an operation performed by the driver assistance apparatus. The output unit <NUM> can output visual, auditory or tactile feedback according to current operation of the driver assistance apparatus.

A power supply <NUM> can supply power necessary for operations of components under the control of the processor <NUM>. Particularly, the power supply <NUM> can provide electric energy of a battery included therein to components of the driver assistance apparatus. If the driver assistance apparatus is provided with electric energy from a battery included in the vehicle, the power supply <NUM> can be omitted.

The processor <NUM> controls overall operation of each unit of the driver assistance apparatus. The processor <NUM> may be implemented using at least one of ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors, controllers, micro-controllers, microprocessors) and other electrical units for executing the corresponding functions.

The processor <NUM> is electrically connected to ISG (Idle Stop and Go) and the interface <NUM>. The processor <NUM> can check the state of the vehicle <NUM> on the basis of electrical signals provided by the ISG and the interface <NUM>. Specifically, the processor <NUM> can check whether the vehicle is in a first state in which ISG is turned on or a second state in which the gearshift of the vehicle <NUM> is positioned at stages other than P stage and the engine of the vehicle is turned on. If the vehicle <NUM> is stopped in the first or second state, the processor <NUM> performs a predetermined operation for stop control of the vehicle <NUM> on the basis of driving information. Here, the predetermined operation for stop control of the vehicle <NUM> may be an operation of maintaining the vehicle <NUM> in a stopped state. Predetermined operations which will be described below may include at least one of an operation of blocking turn off of the ISG, an operation of turning off starting of the vehicle <NUM>, an operation of activating an electronic parking brake (EPB) and an operation of activating the foot brake. When the operation of blocking turn off of the ISG is performed, the ISG is maintained in a turned on state. That is, the engine of the vehicle <NUM> is turned off by the ISG. When the EPB or foot brake is activated, the vehicle <NUM> can be maintained in a stopped state (that, in a state in which wheels do not rotate) according to braking power of the EPB or foot brake even if the engine of the vehicle <NUM> is turned on.

The processor <NUM> can determine whether a predetermined stop preparation condition and stop execution condition are satisfied on the basis of data included in the driving information. As described above, the driving information may include information related to driving. The stop preparation condition is a predetermined condition for situations in which there is a high possibility that the vehicle <NUM> in a stopped state starts to move. The stop execution condition is a predetermined condition for starting stop control of the vehicle <NUM> when the stop preparation condition is satisfied.

If the stop preparation condition and the stop execution condition are sequentially satisfied, the processor <NUM> can perform a predetermined operation.

In one embodiment, the stop preparation condition may include at least one of (i) opening of the driver side door, (ii) release of the driver seat safety belt, (iii) opening of the trunk, (iv) opening of the hood, (v) detection of an obstruction and (vi) occurrence of a crash accident. Here, the stop execution condition may include release of the brake pedal. For example, when the brake pedal is released upon sensing of opening of the hood, the vehicle <NUM> moves forward and thus a crash may occur. In this case, the processor <NUM> can control the vehicle <NUM> to be maintained in the stopped state by performing a predetermined operation such as turning on the ISG.

In an embodiment, the stop preparation condition may include (i) shifting to Neutral (N) or Reverse (R) on an uphill road or (ii) shifting to Neutral (N) or Drive (D) on a downhill road. In this case, the stop execution condition may include release of the brake pedal. For example, if the brake pedal is released when the gearshift is shifted to Reverse (R) on an uphill road, the vehicle <NUM> may move backward and thus may hit a person behind the vehicle. In this case, the processor <NUM> can control the vehicle <NUM> to be maintained in the stopped state by performing a predetermined operation such as activation of the EPB. The processor <NUM> can control braking power of the EPB or foot brake according to the gradient of an uphill road or a downhill road. For example, since risk of an accident of the vehicle <NUM> is high when the gradient of an uphill road or a downhill road is high, the processor <NUM> can increase braking power.

In one embodiment, the stop preparation condition may include a condition that the brake pedal is not released from the last time the vehicle <NUM> is stopped and the stop execution condition may include a condition that the vehicle <NUM> travels at a predetermined speed or higher for a predetermined distance or longer. Even if the driver continuously depresses on the brake pedal, the vehicle <NUM> may move forward or in reverse for various reasons such as aging of the brake apparatus. In this case, the processor <NUM> can stop the vehicle <NUM> by turning off the engine or generating additional braking power through the EPB or foot brake.

In an embodiment, when at least one door of the vehicle <NUM> is open, the processor <NUM> can detect an object caught in the open door. Specifically, driving information received through the interface <NUM> may include a torque value measured by a torque sensor corresponding to the open door. The processor <NUM> can determine that a person is caught between the open door and the body of the vehicle when the torque value of the open door exceeds a threshold value. The processor <NUM> can perform a predetermined operation upon detection of an object caught in the open door.

In an embodiment, the processor <NUM> can determine whether a passenger exits the vehicle <NUM> on the basis of whether each door is open. For example, the processor <NUM> can determine that the driver exits the vehicle when the driver's seat door is open while the driver and a passenger ride in the vehicle <NUM> and determine that the passenger exits the vehicle when a door other than the driver's seat door is open.

If the trunk of the vehicle <NUM> is open, the gearshift is shifted to Reverse (R) and the passenger exits the vehicle <NUM>, the processor <NUM> can perform a predetermined operation according to whether an object moving behind the vehicle <NUM> is detected. Specifically, the interface <NUM> can receive sensing information from at least one sensor provided to the rear side of the vehicle <NUM> and the processor <NUM> can detect an object moving behind the vehicle <NUM> on the basis of the sensing information.

For example, when a pedestrian or another vehicle is moving within a predetermined distance from the read side of the vehicle <NUM>, the processor <NUM> can forcibly stop the vehicle <NUM> in order to prevent an accident due to driving in reverse.

As another example, if the trunk of the vehicle <NUM> is open, the gearshift is shifted to Neutral (N), and the driver releases the brake pedal when the passenger exits the vehicle <NUM>, the vehicle <NUM> moves in reverse and thus may hit the passenger. Accordingly, the processor <NUM> performs a predetermined operation upon release of the brake pedal when an object moving behind the vehicles is detected.

In one embodiment, the interface <NUM> may receive an outdoor image provided by the cameras <NUM> and <NUM> included in the vehicle <NUM>. The processor <NUM> may detect at least one object from the outdoor image and acquire information on the detected object. Here, the information on the detected object may include at least one of the type, position, speed, shape and size of the detected object. If the detected object includes an obstruction, the processor <NUM> may perform a predetermined operation on the basis of the relative position of the obstruction with respect to the vehicle <NUM>. Here, the obstruction may include another vehicle, a pedestrian, a tree, a fallen object and a structure, which can collide with the vehicle <NUM>.

Specifically, if the brake pedal is released when the obstruction is located within a predetermined distance from the front side of the vehicle <NUM> and the gearshift is shifted to Drive (D), the vehicle <NUM> may move forward to collide with the obstruction. To prevent this, the processor <NUM> can perform a predetermined operation. Similarly, if the obstruction is located within a predetermined distance from the rear side of the vehicle <NUM> and the gearshift is shifted to Reverse (R), the processor <NUM> can perform a predetermined operation.

In one embodiment, the processor <NUM> may check whether a door of the vehicle <NUM> is open on the basis of whether each door of the vehicle <NUM> is open and an opening angle of an open door, included in the driving information. If an obstruction is located at the side of an open door, the processor <NUM> can perform a predetermined operation on the basis of the opening angle of the open door. For example, the processor <NUM> can perform the predetermined operation when the opening angle of the open door exceeds a threshold value since risk of collision with the obstruction increases as the opening angle increases.

In one embodiment, the driving information may include information on whether each window of the vehicle <NUM> is open. It is assumed that at least one window of the vehicle <NUM> is open and an obstruction is located at the side of the open window. In this case, it is possible to check whether the object detected from the outdoor image includes a part of the body of the passenger, which protrudes through the open window. For example, when the passenger puts their head or hand out of the open window, the processor <NUM> can detect the head or hand of the passenger from the outdoor image. When the part of the body of the passenger, which protrudes through the open window, is detected from the outdoor image, the processor <NUM> can perform a predetermined operation on the basis of the protruding length of the part of the body of the passenger. If the protruding part of the body of the passenger moves inside the open window, the processor <NUM> can stop the predetermined operation.

When the processor <NUM> performs the predetermined operations in the aforementioned situations, the processor <NUM> can provide messages about the operations through an output device included in the vehicle <NUM>.

<FIG> and <FIG> are block diagrams of the processor <NUM> shown in <FIG>.

Referring to <FIG>, the processor <NUM> may include an image preprocessor <NUM>, a disparity calculator <NUM>, a segmentation unit <NUM>, an object detector <NUM>, an object verification unit <NUM>, an object tracking unit <NUM> and an application unit <NUM>.

The image preprocessor <NUM> may receive an image from the camera module <NUM> shown in <FIG> and preprocess the image. Here, the image may be at least one of a mono image, a stereo image, an around view image and an omnidirectional image.

Specifically, the image preprocessor <NUM> may perform noise reduction, rectification, calibration, color enhancement, color space conversion (CSC), interpolation, camera gain control and the like on the image.

Accordingly, a clearer image than images photographed by the camera module <NUM> can be acquired.

The disparity calculator <NUM> receives a plurality of images or a generated around view image, processed in the image preprocessor <NUM>, performs stereo matching on a plurality of mono images or stereo images, sequentially received for a predetermined time, and acquires a disparity map according to stereo matching. In this manner, the display calculator <NUM> can acquire disparity information about surroundings of the vehicle.

Here, stereo matching can be performed per pixel of images or on a block by block basis. The disparity map refers to a map that represents binocular parallax information of images as numerical values.

A segmentation unit <NUM> may perform segmentation and clustering on images on the basis of the disparity information from the disparity calculator <NUM>.

Specifically, the segmentation unit <NUM> may separate a background and a foreground from at least one image on the basis of the disparity information.

For example, the segmentation unit <NUM> can classify a region corresponding to disparity information less than a predetermined value in the disparity map as a background and exclude the corresponding region from an object detection target. Accordingly, a foreground can be relatively separated.

Alternatively, the segmentation unit <NUM> can classify a region corresponding to disparity information that exceeds the predetermined value in the disparity map as a foreground and extract the foreground, thereby separating the foreground from the background.

When the foreground and the background are separated on the basis of the disparity information extracted based on images, a signal processing speed can be increased and the quantity of processed signals can be reduced during the following object detection process.

The object detector <NUM> may detect an object on the basis of image segmentation of the segmentation unit <NUM>.

The object detector <NUM> may detect an object from at least one image on the basis of the disparity information.

Specifically, the object detector <NUM> may detect an object from at least one image. For example, the object detector <NUM> can detect an object from a foreground separated according to image segmentation.

The object verification unit <NUM> may classify and verify the detected object. To this end, the object verification unit <NUM> may use an identification method using a neural network, a support vector machine (SVM) method, an identification method according to AdaBoost using Haar-like characteristics, histograms of oriented gradients (HOG) or the like.

The object verification unit <NUM> may verify the detected object by comparing information on the detected object with reference information (e.g. characteristic information per object type) stored in the memory.

For example, the object verification unit <NUM> can verify vehicles, lanes, road surfaces, road signs, danger areas, tunnels and the like, located around the corresponding vehicle.

The object tracking unit <NUM> may track the verified object. For example, the object tracking unit <NUM> can verify an object included in sequentially acquired stereo images, calculate motion or a motion vector of the verified object and track movement of the object on the basis of the calculated motion or motion vector. Accordingly, the object tracking unit <NUM> can track vehicles, lanes, road surfaces, road signs, danger zones, tunnels and like around the corresponding vehicle.

The application unit <NUM> may calculate a degree of car accident risk of the vehicle <NUM> on the basis of object information on various objects around the vehicle (e.g., other vehicles, lanes, road surfaces, road signs and the like). In addition, the application unit <NUM> may calculate possibility of rear-end collision with the detected object, slip of the vehicle and the like on the basis of the object information.

Furthermore, the application unit <NUM> may output messages for informing the user of the information on the calculated hazard, rear-end collision possibility or vehicle slip on the basis of the calculated hazard, rear-end collision possibility or vehicle slip. In addition, the application unit <NUM> may generate a control signal for attitude control or driving control of the vehicle <NUM> as vehicle control information.

The processor <NUM> shown in <FIG> differs from the processor <NUM> shown in <FIG> in terms of signal processing order. A description will be given of only such difference.

The object detector <NUM> may receive mono images, stereo images, around view images or omnidirectional images and detect objects included in the received images. Distinguished from <FIG>, the object detector <NUM> can directly detect objects from the mono images, stereo images, around view images or omnidirectional images on the basis of disparity information, rather than detecting an object from a segmented image.

The object verification unit <NUM> classifies and verifies a detected and separated object on the basis of image segmentation of the segmentation unit <NUM> and an object detected by the object detector <NUM>.

To this end, the object verification unit <NUM> may use an identification method using a neural network, a support vector machine (SVM) method, an identification method according to AdaBoost using Haar-like characteristics, histograms of oriented gradients (HOG) or the like.

<FIG> and <FIG> illustrate operations of the processor <NUM> shown in <FIG> to detect an object.

<FIG> and <FIG> show operations of the processor <NUM> to detect an object on the basis of stereo images respectively acquired through the camera <NUM> shown in <FIG> in first and second frame intervals.

Referring to <FIG>, the camera <NUM> acquires stereo images FI1a and FI1b in the first frame interval.

The disparity calculator <NUM> included in the processor <NUM> receives stereo images FR1a and FR1b, which are processed by the image preprocessor <NUM>, and performs stereo matching on the received stereo images FR1a and FR1b so as to acquire a disparity map <NUM>.

The disparity map <NUM> represents levels of disparity between the stereo images FR1a and FR1b. A distance to the vehicle is recognized to be shorter as the disparity level increases and is recognized to be longer as the disparity level decreases.

When the disparity map is displayed, a higher disparity level may be represented as higher brightness and a lower disparity level may be represented as lower brightness.

In <FIG>, first to fourth lanes 828a, 828b, 828c and 828d, a construction zone <NUM>, a first preceding vehicle <NUM> and a second preceding vehicle <NUM> respectively have disparity levels corresponding thereto in the disparity map <NUM>.

The segmentation unit <NUM>, the object detector <NUM> and the object verification unit <NUM> respectively perform segmentation, object detection and object verification on at least one of the stereo images FR1a and FR1b on the basis of the disparity map <NUM>.

<FIG> shows an image <NUM> obtained by performing object detection and verification on the second stereo image FR1b on the basis of the disparity map <NUM>.

The first to fourth lanes 838a, 838b, 838c and 838d, the construction zone <NUM>, the first preceding vehicle <NUM> and the second preceding vehicle <NUM> are displayed in the image <NUM> such that they are separated from a background.

Referring to <FIG>, the camera <NUM> acquires stereo images in the second frame interval following the first frame interval.

The disparity calculator <NUM> included in the processor <NUM> receives stereo images FR2a and FR2b, which are processed by the image preprocessor <NUM>, and performs stereo matching on the received stereo images FR2a and FR2b so as to acquire a disparity map <NUM>.

In <FIG>, first to fourth lanes 848a, 848b, 848c and 848d, a construction zone <NUM>, a first preceding vehicle <NUM> and a second preceding vehicle <NUM> respectively have disparity levels corresponding thereto in the disparity map <NUM>.

The segmentation unit <NUM>, the object detector <NUM> and the object verification unit <NUM> respectively perform segmentation, object detection and object verification on at least one of the stereo images FR2a and FR2b on the basis of the disparity map <NUM>.

<FIG> illustrates an image <NUM> obtained by performing object detection and verification on the second stereo image FR2b using the disparity map <NUM>.

The first to fourth lanes 848a, 848b, 848c and 848d, the construction zone <NUM>, the first preceding vehicle <NUM> and the second preceding vehicle <NUM> are displayed in the image <NUM> such that they are separated from the background.

The object tracking unit <NUM> tracks the objects by comparing the sequentially generated images <NUM> and <NUM>.

Specifically, the object tracking unit <NUM> may track movement of the objects verified in <FIG> and <FIG> on the basis of motions or motion vectors of the objects. Accordingly, the object tracking unit <NUM> can track the lanes, the construction zone, the first preceding vehicle and the second preceding vehicle, which are located around the vehicle <NUM>.

<FIG> is a flowchart of a process S900 that can be performed by the driver assistance apparatus <NUM> according to an embodiment of the present invention. It is assumed that the process S900 which will be described below is initiated when the vehicle <NUM> is stopped. For example, the process S900 can be initiated from when the vehicle <NUM> is temporarily stopped for parking or waiting for a signal.

Referring to <FIG>, the driver assistance apparatus <NUM> may receive driving information from the vehicle (S910).

Specifically, the processor <NUM> may receive driving information, which is information related to a driving state of the vehicle <NUM>, through the interface <NUM> electrically connected to the controller or the sensing unit <NUM> of the vehicle <NUM> in real time or periodically. That is, the interface <NUM> may provide data transmitted from the sensing unit <NUM> to the processor <NUM> at the request of the processor <NUM> or irrespective of a request of the processor <NUM>. Here, the driving information may include at least ISG operation information and engine operation information of the vehicle <NUM>. That is, the driving information may include data indicating whether the engine of the vehicle is turned on or turned off. When the engine of the vehicle <NUM> is turned off, the driving information may include data indicating whether the engine of the vehicle <NUM> is turned off due to ISG turn on. Accordingly, when the engine of the vehicle <NUM> is turned off, the processor <NUM> can determine whether turn off of the engine of the vehicle <NUM> corresponds to temporary turn off due to ISG turn on or complete turn off according to a command of the driver.

In addition, the driving information may include vehicle direction information (e.g. yaw rate), geographical position information of the vehicle <NUM>, vehicle heading information, vehicle speed information, vehicle tilt information, information on door opening/closing, brake pedal information, information on fastening/release of the safety belt <NUM>, information on hood opening/closing, information on trunk opening/closing, gearshift position information, ISG operation information, impact information (e.g. collision part and impulse) and obstruction information (e.g. obstruction position and obstruction type). The driving information may further include an outdoor image, an object sensing signal and navigation information as necessary. Here, the outdoor image may be photographed by the aforementioned cameras <NUM> and <NUM>.

The driver assistance apparatus <NUM> may determine whether the vehicle <NUM> is in a first state in which ISG is turned on using the driving information (S920). When ISG is turned on, the driver assistance apparatus <NUM> may determine whether the vehicle <NUM> is in a second state in which the gearshift <NUM> is positioned at stages (e.g. R, N or D) other than P stage and the engine of the vehicle <NUM> is turned on (S930).

Upon determining that the vehicle <NUM> is in the first state in step S920 or determining that the vehicle <NUM> is in the second state in step S930, the driver assistance apparatus <NUM> may compare the driving information with predetermined stop conditions (S940). The predetermined stop conditions may be conditions for determining whether to perform an operation associated with a function of stopping the vehicle <NUM> (i.e. decreasing the speed to <NUM>). Specifically, the stop conditions may be composed of one or more conditions associated with risk of car accidents such as collision when the vehicle <NUM> is restarted from a stopped state.

One, two or more stop conditions may be present. In the case of two or more stop conditions, the stop conditions may be divided into two or more groups. If one group of stop conditions is satisfied, the processor <NUM> may check whether the other group is satisfied. That is, the processor <NUM> can sequentially determine whether respective groups of stop conditions are satisfied. For example, a plurality of stop conditions can be divided into a stop preparation condition and a stop execution condition and the processor <NUM> can check whether the stop execution condition is satisfied after the stop preparation condition is met. In this case, the driver assistance apparatus <NUM> can perform following step S950 only when the stop preparation condition and the stop execution condition are sequentially satisfied.

The driver assistance apparatus <NUM> may perform a predetermined operation for stop control of the vehicle <NUM> on the basis of a comparison result of step S940 (S950). Here, the predetermined operation is an operation for maintaining the last stopped state of the vehicle <NUM> and may include at least one of (i) blocking turn off of ISG, (ii) turning off the engine of the vehicle <NUM>, (iii) activation of the EPB and (iv) activation of the foot brake <NUM>, for example. When the operation of (i) blocking turn off of ISG or (ii) turning off the engine of the vehicle <NUM> is performed, the engine is stopped and thus movement of the vehicle <NUM> can be restricted. When (iii) activation of the EPB or (iv) activation of the foot brake <NUM> is performed, movement of the vehicle <NUM> can be restricted by braking power of a predetermined level or higher.

A detailed description will be given of operations of the driver assistance apparatus <NUM> to stop the vehicle <NUM> in various situations with reference to <FIG>.

<FIG> is a flowchart of a process related to step S940 of <FIG> and <FIG> illustrates an operation of the driver assistance apparatus <NUM> according to the process of <FIG>.

Referring to <FIG> and <FIG>, the processor <NUM> may determine whether at least one of the doors <NUM> of the vehicle <NUM> is open (S1010).

Specifically, the vehicle <NUM> includes at least the door <NUM> at the driver seat <NUM> and may further include additional doors <NUM> according to the size and use of the vehicle <NUM>. A door opening/closing sensor for sensing whether the door <NUM> of the vehicle <NUM> is open or closed may be provided per door <NUM>. The door opening/closing sensor may be included in the sensing unit <NUM> shown in <FIG>.

While <FIG> shows that driver side door <NUM> is open, the processor <NUM> may check whether a door other than the driver side door <NUM> is open on the basis of a sensing signal provided by the door opening/closing sensor.

A door is open when a person enters or exits the vehicle. When the person enters or exits the vehicle through the open door, the vehicle <NUM> may move forward or in reverse if the brake pedal <NUM> is released even when the vehicle <NUM> is stopped, which may threaten the safety of the person. Accordingly, opening of the door <NUM> may be classified as a stop preparation condition.

Upon determining that at least one of the doors <NUM> of the vehicle <NUM> is open, the processor <NUM> may determine whether the brake pedal <NUM> has been released (S1020). Release of the brake pedal <NUM> may be a stop execution condition. Since opening of the door <NUM> corresponding to a stop preparation condition has been satisfied, the processor <NUM> can perform step S950 if release of the brake pedal <NUM> corresponding to a stop execution condition is met.

When the vehicle <NUM> includes a plurality of doors <NUM>, the processor <NUM> may differentially perform predetermined operations according to the number of open doors <NUM>. For example, when only one door <NUM> is open, the processor <NUM> performs the operation of turning off the engine of the vehicle <NUM>. When two or more doors are simultaneously open, the processor <NUM> additionally performs the EPB activation operation.

Referring to <FIG> and <FIG>, the processor <NUM> may determine whether at least one safety belt <NUM> of the vehicle <NUM> is released (S1210). The safety belt <NUM> may be provided per seat of the vehicle <NUM>. For example, the safety belt <NUM> can be a <NUM>-point safety belt including a pelvic belt and a shoulder belt.

Specifically, the vehicle <NUM> includes at least the safety belt <NUM> at the driver seat <NUM> and may further include additional safety belts <NUM> according to the size and use of the vehicle <NUM>. A safety belt sensor for sensing whether the safety belt <NUM> of the vehicle <NUM> is fastened or released may be provided per safety belt <NUM>. The safety belt sensor may be included in the sensing unit <NUM> shown in <FIG>.

While <FIG> shows that the safety belt <NUM> of the driver seat <NUM> is released, the processor <NUM> may check whether a safety belt other than the driver seat safety belt <NUM> is fastened/released on the basis of a sensing signal provided by the safety belt sensor.

The safety belt <NUM> is released when a passenger on the seat corresponding to the released safe belt exits the vehicle <NUM>. When the person exits the vehicle, the vehicle <NUM> may move forward or in reverse if the brake pedal <NUM> is released even when the vehicle <NUM> is stopped, which may threaten the safety of the passenger. Accordingly, release of the safety belt <NUM> may be classified as a stop preparation condition.

Upon determining that at least one safety belt <NUM> of the vehicle <NUM> is released, the processor <NUM> may determine whether the brake pedal <NUM> has been released (S1220). Release of the brake pedal <NUM> may be a stop execution condition. Since release of the safety belt <NUM> corresponding to a stop preparation condition has been satisfied, the processor <NUM> can perform step S950 if release of the brake pedal <NUM> corresponding to a stop execution condition is met.

When the vehicle <NUM> includes a plurality of safe belts <NUM>, the processor <NUM> may differentially perform predetermined operations according to the number of safety belts <NUM>. For example, when one safety belt <NUM> is released, the processor <NUM> performs the operation of turning off the engine of the vehicle <NUM>. When two or more safety belts are released, the processor <NUM> additionally performs the EPB activation operation.

Referring to <FIG> and <FIG>, the processor <NUM> may determine whether at least one of the hood <NUM> and the trunk <NUM> of the vehicle <NUM> is open (S1410).

Specifically, the vehicle <NUM> includes the hood <NUM> for shielding the engine compartment and the trunk <NUM> for loading baggage. A sensor for sensing whether the hood <NUM> or the trunk <NUM> is open or closed may be included in the sensing unit <NUM> shown in <FIG>.

A passenger can open the trunk <NUM> by pushing a trunk opening switch provided to the passenger compartment of the vehicle <NUM> or open the hood <NUM> by pressing a hood opening switch.

While <FIG> shows that both the trunk <NUM> and the hood <NUM> are open, the processor <NUM> may perform the corresponding operation when only one of the trunk <NUM> and the hood <NUM> is open.

The hood <NUM> may be open when the engine compartment needs to be checked and the trunk <NUM> may be open when a passenger attempts to load baggage. That is, possibility that the passenger is located close to the vehicle <NUM> is high.

When the passenger opens the hood <NUM> or the trunk <NUM>, the vehicle <NUM> may move forward or in reverse if the brake pedal <NUM> is released even when the vehicle <NUM> is stopped, which may threaten the safety of the passenger close to the hood <NUM> or the trunk <NUM>. Accordingly, opening of the hood <NUM> and the trunk <NUM> may correspond to a stop preparation condition.

Upon determining that at least one of the hood <NUM> and the trunk <NUM> of the vehicle <NUM> is open, the processor <NUM> may determine whether the brake pedal <NUM> has been released (S1420). Here, release of the brake pedal <NUM> may correspond to a stop execution condition. Since opening of at least one of the hood <NUM> and the trunk <NUM> corresponding to a stop preparation condition has been satisfied, the processor <NUM> can perform step S950 if release of the brake pedal <NUM> corresponding to a stop execution condition is met.

Referring to <FIG> and <FIG>, the processor <NUM> may determine whether the vehicle <NUM> has crashed (S1610).

Specifically, the vehicle <NUM> may include a plurality of impact sensors provided inside thereof. The impact sensors are disposed at predetermined positions and provide sensing signals corresponding to impulse applied thereto to the driver assistance apparatus <NUM>. Such impact sensors may be included in the sensing unit <NUM> shown in <FIG>.

<FIG> shows a situation in which another vehicle <NUM> collides with the right side of the vehicle <NUM>. The processor <NUM> can calculate a colliding portion of the body of the vehicle and impulse on the basis of sensing signals provided by the impact sensors.

When the crash accident occurs, the foot of the driver may be removed from the brake pedal <NUM> to release the brake pedal <NUM>. Since the vehicle <NUM> may move forward or in reverse if the brake pedal <NUM> is released due to abrupt movement of the vehicle caused by the crash accident even when the vehicle <NUM> is stopped at the moment of collision, there is a high possibility of occurrence of another accident. Accordingly, occurrence of a crash accident may correspond to a stop preparation condition.

Upon determining that the vehicle <NUM> has crashed, the processor <NUM> may determine whether the brake pedal <NUM> has been released (S1620). Here, release of the brake pedal <NUM> may correspond to a stop execution condition. Since occurrence of the crash accident corresponding to a stop preparation condition has been satisfied, the processor <NUM> can perform step S950 if release of the brake pedal <NUM> corresponding to a stop execution condition is met.

The processor <NUM> may differentially perform predetermined operations according to the magnitude of impulse caused by the crash accident. For example, when the impulse corresponds to a first level, the processor <NUM> performs the operation of turning off starting of the vehicle <NUM>. When the impulse corresponds to a second level higher than the first level, the processor <NUM> additionally performs the EPB activation operation.

<FIG> is a flowchart of a process related to step S940 of <FIG> and <FIG> illustrates an operation of the driver assistance apparatus <NUM> according to the process of <FIG>. For convenience of description, it is assumed that the vehicle <NUM> is located on flat land.

Referring to <FIG> and <FIG>, the processor <NUM> may determine whether an obstruction in front of the vehicle <NUM> has been detected (S1810).

Specifically, the processor <NUM> may receive a front view image of the vehicle <NUM> from the cameras 161a and <NUM> and detect at least one object from the received front view image. The processor <NUM> may classify an obstruction included in the detected object. For example, if the detected object includes a lane, a traffic sign, a pedestrian and another vehicle, the processor <NUM> can classify the lane and the traffic sign as non-obstructions and classify the pedestrian and the other vehicle as obstructions.

<FIG> shows a situation in which an obstruction <NUM> is located within a predetermined distance from the front side of the vehicle <NUM>. For example, the obstruction <NUM> may be a pedestrian as shown in the figure or another vehicle, a wall or a tree.

The processor <NUM> may determine whether the gearshift <NUM> is shifted to D (S1820). Specifically, if the gearshift <NUM> is shifted to Park (P), Reverse (R) or Neutral (N) when the obstruction <NUM> is located within a predetermined distance from the front side of the vehicle <NUM>, the vehicle <NUM> does not collide with the obstruction <NUM> even if the brake pedal <NUM> is released. However, if the gearshift <NUM> is shifted to Drive (D), the vehicle <NUM> may move forward to collide with the obstruction <NUM> when the brake pedal <NUM> is released. Accordingly, the processor <NUM> checks whether the gearshift <NUM> is shifted to Drive (D) in step S1820 upon detection of the obstruction <NUM> in step S1810.

If the brake pedal <NUM> is released while the vehicle <NUM> is stopped when the obstruction <NUM> is located in front of the vehicle <NUM> and the gearshift <NUM> is shifted to D, the vehicle <NUM> may move forward to collide with the neighboring obstruction <NUM>. Accordingly, detection of the obstruction in front of the vehicle and shifting of the gearshift <NUM> to Drive (D) may correspond to stop preparation conditions.

When the stop preparation conditions are satisfied, the processor <NUM> may determine whether the brake pedal <NUM> has been released (S1830). Here, release of the brake pedal <NUM> may correspond to a stop execution condition. Since detection of the obstruction in front of the vehicle and shifting of the gearshift <NUM> to Drive (D) corresponding to stop preparation conditions have been satisfied, the processor <NUM> can perform step S950 if release of the brake pedal <NUM> corresponding to a stop execution condition is met.

The processor <NUM> may differentially perform predetermined operations according to the distance between the vehicle <NUM> and the obstruction <NUM> in front thereof. For example, when the distance between the vehicle <NUM> and the obstruction <NUM> in front thereof corresponds to a first value, the processor <NUM> performs the operation of turning off the engine of the vehicle <NUM>. When the distance between the vehicle <NUM> and the obstruction <NUM> in front thereof corresponds to a second value less than the first value, the processor <NUM> additionally performs the EPB activation operation.

Referring to <FIG> and <FIG>, the processor <NUM> may determine whether an obstruction behind the vehicle <NUM> has been detected (S2010).

Specifically, the processor <NUM> may receive a rear view image of the vehicle <NUM> from the camera 161d and detect at least one object from the received rear view image. The processor <NUM> may classify an obstruction included in the detected object. For example, if the detected object includes a lane, a traffic sign, a pedestrian and another vehicle, the processor <NUM> can classify the lane and the traffic sign as non-obstructions and classify the pedestrian and the other vehicle as obstructions.

<FIG> shows a situation in which an obstruction <NUM> is located within a predetermined distance from the rear side of the vehicle <NUM>. For example, the obstruction <NUM> may be a pedestrian, as shown in the figure, another vehicle, a wall or a tree.

The processor <NUM> may determine whether the gearshift <NUM> is shifted to Reverse (R) (S2020). Specifically, if the gearshift <NUM> is shifted to P, N or D when the obstruction <NUM> is located within a predetermined distance from the rear side of the vehicle <NUM>, the vehicle <NUM> does not collide with the obstruction <NUM> even if the brake pedal <NUM> is released. However, if the gearshift <NUM> is shifted to R, the vehicle <NUM> may move in reverse to collide with the obstruction <NUM> when the brake pedal <NUM> is released. Accordingly, the processor <NUM> checks whether the gearshift <NUM> is shifted to R in step S2020 upon detection of the obstruction <NUM> in step S2010.

If the brake pedal <NUM> is released while the vehicle <NUM> is stopped when the obstruction <NUM> is located behind the vehicle <NUM> and the gearshift <NUM> is shifted to R, the vehicle <NUM> may move in reverse to collide with the neighboring obstruction <NUM>. Accordingly, detection of the obstruction behind the vehicle and shifting of the gearshift <NUM> to R may correspond to stop preparation conditions.

When the stop preparation conditions are satisfied, the processor <NUM> may determine whether the brake pedal <NUM> has been released (S2030). Here, release of the brake pedal <NUM> may correspond to a stop execution condition. Since detection of the obstruction behind the vehicle and shifting of the gearshift <NUM> to R, which correspond to stop preparation conditions, have been satisfied, the processor <NUM> can perform step S950 if release of the brake pedal <NUM> corresponding to a stop execution condition is met.

The processor <NUM> may differentially perform predetermined operations according to the distance between the vehicle <NUM> and the obstruction <NUM> behind the vehicle. For example, when the distance between the vehicle <NUM> and the obstruction <NUM> corresponds to a first value, the processor <NUM> performs the operation of turning off starting of the vehicle <NUM>. When the distance between the vehicle <NUM> and the obstruction <NUM> corresponds to a second value less than the first value, the processor <NUM> additionally performs the EPB activation operation.

Referring to <FIG> and <FIG>, the processor <NUM> may determine whether at least one of the doors <NUM> of the vehicle <NUM> is open (S2210).

Specifically, the vehicle <NUM> includes at least the door <NUM> at the driver seat <NUM> and may further include additional doors <NUM> according to the size and use of the vehicle <NUM>. A door opening/closing sensor may be provided per door <NUM>. The door opening/closing sensor may be included in the sensing unit <NUM> shown in <FIG>. Specifically, the door opening/closing sensor can sense whether each door <NUM> of the vehicle <NUM> is open or closed. The door opening/closing sensor may measure an opening angle of an open door. In this case, opening of a door may correspond to a stop preparation condition.

When the door <NUM> is open, the processor <NUM> may acquire a torque value of the open door <NUM> (S2220). In this case, a torque sensor may be provided per door <NUM>. The torque sensor may be included in the sensing unit <NUM> shown in <FIG>. Specifically, the torque sensor may be provided to the shaft (e.g. hinge) of each door <NUM> to measure a torque value with respect to a door closing direction.

The door <NUM> is open when a person <NUM> enters of exits the vehicle. When the vehicle <NUM> moves while the person <NUM> does not completely ride in the vehicle through the open door, the person <NUM> may be caught between the open door <NUM> and the body of the vehicle. If the vehicle <NUM> continuously moves with the person <NUM> caught between the open door <NUM> and the body of the vehicle, not only the safety of the person <NUM> is threatened but also the door <NUM> is damaged. Accordingly, the processor <NUM> may determine whether an object is caught between the open door and the body of the vehicle by acquiring a torque value from the torque sensor.

Subsequently, the processor <NUM> may determine whether the acquired torque value exceeds a predetermined threshold value (S2330). That is, the processor <NUM> can determine whether an object is caught between the open door and the body of the vehicle. Here, a torque value exceeding the threshold value may correspond to a stop execution condition. Since opening of the door <NUM> corresponding to a stop preparation condition has been satisfied, the processor <NUM> can perform step S950 if the torque value exceeding the threshold value, which corresponds to a stop execution condition, is met.

The processor <NUM> may differentially perform predetermined operations according to the torque value. For example, when the torque value corresponds to <NUM> times the threshold value, the processor <NUM> performs the operation of turning off starting of the vehicle <NUM>. When the torque value corresponds to <NUM> times the threshold value, the processor <NUM> additionally performs the EPB activation operation.

Referring to <FIG> and <FIG>, the processor <NUM> may detect an obstruction <NUM> within a predetermined range from the vehicle <NUM> (S2410). For example, the processor <NUM> can detect the obstruction <NUM> from an outdoor image provided by the cameras <NUM> and <NUM>. Alternatively, the processor <NUM> may detect the obstruction <NUM> on the basis of sensing signals provided by one or more sensors <NUM>, <NUM> and <NUM> provided to the exterior of the vehicle <NUM>, as shown in <FIG>. In addition, the processor <NUM> may calculate the position of the detected obstruction <NUM> on the basis of the vehicle <NUM>.

The processor <NUM> may determine whether a door <NUM> at the side of the obstruction <NUM> from among the doors <NUM> of the vehicle <NUM> is open (S2420). Specifically, the vehicle <NUM> includes at least the door <NUM> at the driver seat <NUM> and may further include additional doors <NUM> according to the size and use of the vehicle <NUM>. Here, a door opening/closing sensor may be provided per door <NUM>. The door opening/closing sensor may be included in the sensing unit <NUM> shown in <FIG>. Specifically, the door opening/closing sensor can sense whether each door <NUM> of the vehicle <NUM> is open or closed. For example, the processor <NUM> can determine whether the left door is open when the obstruction <NUM> is located at the left of the vehicle <NUM> and determine whether the right door is open when the obstruction <NUM> is located at the right of the vehicle <NUM>. In this case, opening of the door <NUM> at the side of the obstruction <NUM> may correspond to a stop preparation condition.

While <FIG> shows that the right door <NUM> of the rear seat of the vehicle <NUM> is open, the processor <NUM> may check whether other doors are open on the basis of a sensing signal provided by the door opening/closing sensor.

Upon determining that the door <NUM> at the side of the obstruction <NUM> is open in step S2420, the processor <NUM> may acquire information on the opening angle of the open door <NUM> (S2430). Specifically, the processor <NUM> may receive the information on the opening angle measured by the door opening/closing sensor provided to the open door <NUM>.

The door <NUM> is open when a person enters or exits the vehicle. When the vehicle <NUM> moves to the obstruction <NUM> with the door <NUM> open, the open door <NUM> may collide with the obstruction <NUM> and be damaged. If the obstruction <NUM> is a person, the person may be injured.

Subsequently, the processor <NUM> may determine whether the acquired opening angle exceeds a predetermined threshold value (S2440). As the opening angle increases (i.e. the door <NUM> is open wider), risk of collision of the open door <NUM> with the obstruction <NUM> increases. Here, an opening angle exceeding the threshold value may correspond to a stop execution condition. Since opening of the door <NUM> at the side of the obstruction <NUM>, which corresponds to a stop preparation condition, has been satisfied, the processor <NUM> can perform step S950 if the opening angle exceeding the threshold value, which corresponds to a stop execution condition, is met.

The processor <NUM> may differentially perform predetermined operations according to the opening angle of the open door <NUM>.

Referring to <FIG> and <FIG>, the processor <NUM> may detect an obstruction <NUM> within a predetermined range from the vehicle <NUM> (S2610). For example, the processor <NUM> can detect the obstruction <NUM> from an outdoor image provided by the cameras <NUM> and <NUM>. Alternatively, the processor <NUM> may detect the obstruction <NUM> on the basis of sensing signals provided by one or more sensors <NUM>, <NUM> and <NUM> provided to the exterior of the vehicle <NUM>, as shown in <FIG>. In addition, the processor <NUM> may calculate the position of the detected obstruction <NUM> on the basis of the vehicle <NUM>.

The processor <NUM> may determine whether a window <NUM> at the side of the obstruction <NUM> from among the windows <NUM> of the vehicle <NUM> is open (S2620). Specifically, the vehicle <NUM> includes at least the window <NUM> at the driver seat <NUM> and may further include additional windows <NUM> according to the size and use of the vehicle <NUM>. Here, a window opening/closing sensor may be provided per window <NUM>. The window opening/closing sensor may be included in the sensing unit <NUM> shown in <FIG>. Specifically, the window opening/closing sensor can sense whether each window <NUM> of the vehicle <NUM> is open or closed. For example, the processor <NUM> can determine whether the left window is open when the obstruction <NUM> is located at the left of the vehicle <NUM> and determine whether the right window is open when the obstruction <NUM> is located at the right of the vehicle <NUM>. In this case, opening of the window <NUM> at the side of the obstruction <NUM> may correspond to a stop preparation condition.

While <FIG> shows that the left window <NUM> of the front seat of the vehicle <NUM> is open, the processor <NUM> may check whether other windows <NUM> are open on the basis of a sensing signal provided by the window opening/closing sensor.

Upon determining that the window <NUM> at the side of the obstruction <NUM> is open in step S2620, the processor <NUM> may determine whether part <NUM> of the body of the passenger protrudes from the open window <NUM> (S2630). Specifically, the processor <NUM> may detect an object from outdoor images provided by the cameras 161b and 161c and check whether the detected object includes the part <NUM> of the body of the passenger. For example, when the passenger opens the window <NUM> and protrudes their head or a hand, the cameras 161b and 161c may photograph the head or hand of the passenger. Accordingly, the processor <NUM> may analyze images captured by the cameras 161b and 161c to detect the part of the body of the passenger, such as the head or hand. Protrusion of the part <NUM> of the body of the passenger from the open window <NUM> may correspond to a stop execution condition.

The processor <NUM> may automatically perform a predetermined operation according to the protruding length of the part <NUM> of the body of the passenger and the distance between the vehicle and the obstruction <NUM>.

<FIG> is a flowchart of a process related to step S940 of <FIG> and <FIG> and <FIG> illustrate operations of the driver assistance apparatus <NUM> according to the process of <FIG>.

Referring to <FIG>, <FIG> and <FIG>, the processor <NUM> may acquire information on the slope of a road on which the vehicle <NUM> is located (S2810). The information on the slope of the road may include a slope direction and a gradient. That is, the slope information may include information on whether the road is an uphill road or a downhill road and the gradient of the road.

The slope information may be measured by the sensing unit <NUM>. For example, the tilt sensor can measure the slope direction and gradient of the road and provide the measured information to the driver assistance apparatus <NUM>. The slope information may be included in navigation information. For example, the controller can acquire slope information of the road on which the vehicle <NUM> is currently located by matching the GPS position of the vehicle <NUM> with an electronic map prestored in the memory <NUM> and provide the acquired slope information to the driver assistance apparatus <NUM>. Alternatively, the processor <NUM> may directly calculate the slope direction and gradient of the road on which the vehicle <NUM> is located by analyzing a front view image provided by the camera <NUM>.

The processor <NUM> may determine whether the road on which the vehicle <NUM> is located is an uphill road on the basis of the slope information acquired in step S2810 (S2820). Upon determining that the road is an uphill road, as shown in <FIG>, the processor <NUM> may determine whether the gearshift <NUM> is shifted to N or R on the basis of driving information (S2830). When the gearshift <NUM> is shifted to P or D on an uphill road, the vehicle <NUM> does not move in reverse even if the brake pedal <NUM> is released. However, when the gearshift <NUM> is shifted to N or R on the uphill road, the vehicle <NUM> may move in reverse if the brake pedal <NUM> is released, causing an accident. Accordingly, location of the vehicle <NUM> on an uphill road and the gearshift position at N or R may correspond to stop preparation conditions.

The processor <NUM> may determine whether the road on which the vehicle <NUM> is located is a downhill road on the basis of the slope information acquired in step S2810 (S2840). Upon determining that the road is a downhill road, as shown in <FIG>, the processor <NUM> may determine whether the gearshift <NUM> is shifted to N or D on the basis of the driving information (S2850). When the gearshift <NUM> is shifted to P or R on a downhill road, the vehicle <NUM> does not move forward even if the brake pedal <NUM> is released. However, when the gearshift <NUM> is shifted to N or D on the downhill road, the vehicle <NUM> may move forward if the brake pedal <NUM> is released, causing an accident. Accordingly, location of the vehicle <NUM> on a downhill road and the gearshift position at N or D may correspond to stop preparation conditions.

When the result of one of steps S2830 and S2850 is "yes", the processor <NUM> may determine whether the brake pedal <NUM> has been released (S2860). Here, release of the brake pedal <NUM> may correspond to a stop execution condition. Since the stop preparation conditions according to <FIG> have been satisfied, the processor <NUM> can perform step S950 if release of the brake pedal <NUM> corresponding to a stop execution condition is met.

When the predetermined operation performed through step S950 includes activation of the EPB or the foot brake, the processor <NUM> can differentially perform predetermined operations according to the gradient of the road. For example, the processor <NUM> can increase braking power according to the EPB or the foot brake <NUM> as the gradient of the road increases (i.e. when the road is steeper). Conversely, the processor <NUM> can decrease braking power according to the EPB or the foot brake <NUM> as the gradient of the road decreases (i.e. when the road is gentler).

Claim 1:
A driver assistance apparatus (<NUM>) for a vehicle provided with ISG (Idle Stop and Go), comprising:
an interface (<NUM>) and
a processor (<NUM>) electrically connected to the ISG and the interface, and configured to receive driving information of the vehicle via the interface (<NUM>)
wherein the processor (<NUM>) is configured to perform a predetermined operation for stop control of the vehicle on the basis of the driving information, when the vehicle is stopped in a first state in which the ISG is turned on or in a second state in which a gearshift of the vehicle is positioned at stages other than Park (P) and an engine of the vehicle is turned on,
wherein the predetermined operation includes at least one of blocking turning off the ISG, turning off the engine of the vehicle, activation of an electronic parking brake and activation of a foot brake,
characterized in that
the processor (<NUM>) is further configured to:
determine whether a predetermined stop preparation condition and stop execution condition are satisfied on the basis of data included in the driving information and
perform the predetermined operation when the stop preparation condition and stop execution condition are sequentially satisfied,
wherein the stop preparation condition includes occurrence of a crash accident and the stop execution condition includes release of a brake pedal,
wherein the processor is further configured to differentially perform predetermined operations according to the magnitude of impulse caused by the crash accident,
wherein, when the impulse corresponds to a first level, the processor (<NUM>) performs the operation of turning off the engine of the vehicle (<NUM>) and when the impulse corresponds to a second level higher than the first level, the processor (<NUM>) additionally performs the electronic parking brake activation operation,
wherein the processor is configured to perform the electronic parking brake activation operation by generating braking power of the electronic parking brake.