Patent Description:
A vehicle is a machine that a user may move in a desired direction. A typical example of a vehicle may be an automobile.

Meanwhile, various sensors, electronic devices, and the like, are provided for convenience of users of vehicles. In particular, research into an advanced driver assistance system (ADAS) has been actively conducted for driving convenience of users. In addition, autonomous vehicles have been actively developed.

As the ADAS has been actively developed, the necessity to develop a technology that maximizes user convenience and safety in a vehicle operation has emerged.

Meanwhile, in the related art, in order to set a destination or a route, a user should directly input or select the destination or route. Thus, there is a growing need for a method for simply setting a destination or a stopover.

<CIT> relates to an image display system including a server having a storage device that stores images and a mobile terminal having a display device that displays the images acquired from the server. The mobile terminal includes an operation input device that input a refinement condition of images and selects a display image and a control device that sets a location related to a selected image as a destination. The server includes an extraction device that extracts multiple images according to the refinement condition obtained from the mobile terminal.

<CIT> relates to a device for inputting a travel destination into a navigational device used for navigating a motor vehicle in a road network. The inputting device suggests travel destinations to the user, according to predefined criteria, by displaying images of the travel destinations. By choosing an image, the user can select a travel destination.

<CIT> relates to a vehicle navigation system including a navigation information provider for providing navigation information comprising at least one of origination information, vehicle location information and destination information for guiding a driver to a desired destination, a display unit for displaying the navigation information, a camera unit for generating a front-view image by photographing a front-view of a vehicle and a front-view image storage for storing the front-view image and receiving the vehicle location information from the navigation information provider.

<CIT> relates to a route searching device for searching a route leading from a present location to a destination, comprising a data obtaining portion for obtaining present-location data representing said present location, a map-data storage portion for storing map data, an image-file input portion for inputting an image file in which destination-position data representing a position of said destination is added in advance to image data representing an image of the destination and a route searching portion for searching said route leading from said present location to said destination on the basis of said present-location data, said map data and said destination-position data of said image file.

<CIT> relates to a car navigation system and a car navigation device which can load a memory card that records multiple image files taken by an image taking device with GPS function. All thumbnail image data in the header of the image file, which is recorded in the memory card loaded in the navigation device, is read to display a list of thumbnail images represented by the thumbnail image data. If any of the displayed thumbnail images is selected according to the operation of the cross key, GPS data corresponding to the selected thumbnail image is read to display a position represented by GPS data.

<CIT> relates to systems, methods and devices for providing customized trip plans by identification of one or more travel destinations based on information provided by a user, geo-tagged photographs, and/or travelogues.

<CIT> relates to a method and apparatus for providing point of interest (POI) information of a mobile terminal. The method and apparatus extract POI information, where the POI information and/or associated road information is included in an image captured by a camera. Location information of an image capture place and image capture direction information are read from the digital photo image, and the POI information corresponding to the location and image capture direction information is extracted from a map data, and the extracted POI information is thereafter displayed on the digital photo image.

The present invention is directed to solving the above-mentioned problems and other problems. It is another object of the present invention to provide a vehicle control device capable of receiving a plurality of images from an external device, extracting a corresponding destination for each of the received images, and guiding the extracted destination, and a method for controlling a vehicle. Therefore, it is clear for the skilled person that the term "vehicle control device" used herein refers to a control device for use in a vehicle.

The aforementioned objects are achieved by a vehicle control device according to claim <NUM> and a method for controlling a vehicle including a display unit according to claim <NUM>. In this regard, it is clear to the skilled person that the term "method for controlling a vehicle" refers to the control of at least one unit or device of the vehicle.

Further scope of applicability of the present application will become more apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the scope of the claims will become apparent to those skilled in the art from the detailed description.

Description will now be given in detail according to exemplary embodiments disclosed herein, with reference to the accompanying drawings. For the sake of brief description with reference to the drawings, the same or equivalent components may be provided with the same or similar reference numbers, and description thereof will not be repeated. In general, a suffix such as "module" and "unit" may be used to refer to elements or components. Use of such a suffix herein is merely intended to facilitate description of the specification, and the suffix itself is not intended to give any special meaning or function. In the present disclosure, that which is well-known to one of ordinary skill in the relevant art has generally been omitted for the sake of brevity. The accompanying drawings are used to help easily understand various technical features and it should be understood that the embodiments presented herein are not limited by the accompanying drawings.

It will be understood that when an element is referred to as being "connected with" another element, the element can be connected with the other element or intervening elements may also be present. In contrast, when an element is referred to as being "directly connected with" another element, there are no intervening elements present.

A vehicle according to an embodiment of the present invention may be understood as a conception including cars, motorcycles and the like. Hereinafter, the vehicle will be described based on a car.

The vehicle according to the embodiment of the present invention may be a conception including all of an internal combustion engine car having an engine as a power source, a hybrid vehicle having an engine and an electric motor as power sources, an electric vehicle having an electric motor as a power source, and the like.

In the following description, a left side of a vehicle refers to a left side in a driving direction of the vehicle, and a right side of the vehicle refers to a right side in the driving direction.

<FIG> is a view illustrating appearance of a vehicle in accordance with an embodiment of the present invention.

<FIG> is a view illustrating appearance of a vehicle at various angles in accordance with an embodiment of the present invention.

<FIG> and <FIG> are views illustrating an inside of a vehicle in accordance with an embodiment of the present invention.

<FIG> and <FIG> are reference views illustrating objects in accordance with an embodiment of the present invention.

<FIG> is a block diagram illustrating a vehicle in accordance with an embodiment of the present invention.

As illustrated in <FIG>, a vehicle <NUM> may include wheels turning by a driving force, and a steering apparatus <NUM> for adjusting a driving (ongoing, moving) direction of the vehicle <NUM>.

The vehicle <NUM> may be an autonomous vehicle.

The vehicle <NUM> may be switched into an autonomous mode or a manual mode based on a user input.

For example, the vehicle may be converted from the manual mode into the autonomous mode or from the autonomous mode into the manual mode based on a user input received through a user interface apparatus <NUM>.

The vehicle <NUM> may be switched into the autonomous mode or the manual mode based on driving environment information. The driving environment information may be generated based on object information provided from an object detecting apparatus <NUM>.

For example, the vehicle <NUM> may be switched from the manual mode into the autonomous mode or from the autonomous module into the manual mode based on driving environment information generated in the object detecting apparatus <NUM>.

In an example, the vehicle <NUM> may be switched from the manual mode into the autonomous mode or from the autonomous module into the manual mode based on driving environment information received through a communication apparatus <NUM>.

The vehicle <NUM> may be switched from the manual mode into the autonomous mode or from the autonomous module into the manual mode based on information, data or signal provided from an external device.

When the vehicle <NUM> is driven in the autonomous mode, the autonomous vehicle <NUM> may be driven based on an operation system <NUM>.

For example, the autonomous vehicle <NUM> may be driven based on information, data or signal generated in a driving system <NUM>, a parking exit system <NUM> and a parking system <NUM>.

When the vehicle <NUM> is driven in the manual mode, the autonomous vehicle <NUM> may receive a user input for driving through a driving control apparatus <NUM>. The vehicle <NUM> may be driven based on the user input received through the driving control apparatus <NUM>.

An overall length refers to a length from a front end to a rear end of the vehicle <NUM>, a width refers to a width of the vehicle <NUM>, and a height refers to a length from a bottom of a wheel to a roof. In the following description, an overall-length direction L may refer to a direction which is a criterion for measuring the overall length of the vehicle <NUM>, a width direction W may refer to a direction that is a criterion for measuring a width of the vehicle <NUM>, and a height direction H may refer to a direction that is a criterion for measuring a height of the vehicle <NUM>.

As illustrated in <FIG>, the vehicle <NUM> may include a user interface apparatus <NUM>, an object detecting apparatus <NUM>, a communication apparatus <NUM>, a driving control apparatus <NUM>, a vehicle operating apparatus <NUM>, a operation system <NUM>, a navigation system <NUM>, a sensing unit <NUM>, an interface unit <NUM>, a memory <NUM>, a controller <NUM> and a power supply unit <NUM>.

According to embodiments, the vehicle <NUM> may include more components in addition to components to be explained in this specification or may not include some of those components to be explained in this specification.

The user interface apparatus <NUM> is an apparatus for communication between the vehicle <NUM> and a user. The user interface apparatus <NUM> may receive a user input and provide information generated in the vehicle <NUM> to the user. The vehicle <NUM> may implement user interfaces (Uls) or user experiences (UXs) through the user interface apparatus <NUM>.

The user interface apparatus <NUM> may include an input unit <NUM>, an internal camera <NUM>, a biometric sensing unit <NUM>, an output unit <NUM> and a processor <NUM>.

According to embodiments, the user interface apparatus <NUM> may include more components in addition to components to be explained in this specification or may not include some of those components to be explained in this specification.

The input unit <NUM> may allow the user to input information. Data collected in the input unit <NUM> may be analyzed by the processor <NUM> and processed as a user's control command.

The input unit <NUM> may be disposed within the vehicle. For example, the input unit <NUM> may be disposed on one area of a steering wheel, one area of an instrument panel, one area of a seat, one area of each pillar, one area of a door, one area of a center console, one area of a headlining, one area of a sun visor, one area of a wind shield, one area of a window or the like.

The input unit <NUM> may include a voice input module <NUM>, a gesture input module <NUM>, a touch input module <NUM>, and a mechanical input module <NUM>.

The audio input module <NUM> may convert a user's voice input into an electric signal. The converted electric signal may be provided to the processor <NUM> or the controller <NUM>.

The voice input module <NUM> may include at least one microphone.

The gesture input module <NUM> may convert a user's gesture input into an electric signal. The converted electric signal may be provided to the processor <NUM> or the controller <NUM>.

The gesture input module <NUM> may include at least one of an infrared sensor and an image sensor for detecting the user's gesture input.

According to embodiments, the gesture input module <NUM> may detect a user's three-dimensional (3D) gesture input. To this end, the gesture input module <NUM> may include a light emitting diode outputting a plurality of infrared rays or a plurality of image sensors.

The gesture input module <NUM> may detect the user's 3D gesture input by a time of flight (TOF) method, a structured light method or a disparity method.

The touch input module <NUM> may convert the user's touch input into an electric signal. The converted electric signal may be provided to the processor <NUM> or the controller <NUM>.

The touch input module <NUM> may include a touch sensor for detecting the user's touch input.

According to an embodiment, the touch input module <NUM> may be integrated with the display unit <NUM> so as to implement a touch screen. The touch screen may provide an input interface and an output interface between the vehicle <NUM> and the user.

The mechanical input module <NUM> may include at least one of a button, a dome switch, a jog wheel and a jog switch. An electric signal generated by the mechanical input module <NUM> may be provided to the processor <NUM> or the controller <NUM>.

The mechanical input module <NUM> may be arranged on a steering wheel, a center fascia, a center console, a cockpit module, a door and the like.

The internal camera <NUM> may acquire an internal image of the vehicle. The processor <NUM> may detect a user's state based on the internal image of the vehicle. The processor <NUM> may acquire information related to the user's gaze from the internal image of the vehicle. The processor <NUM> may detect a user gesture from the internal image of the vehicle.

The biometric sensing unit <NUM> may acquire the user's biometric information. The biometric sensing module <NUM> may include a sensor for detecting the user's biometric information and acquire fingerprint information and heart rate information regarding the user using the sensor. The biometric information may be used for user authentication.

The output unit <NUM> may generate an output related to a visual, audible or tactile signal.

The output unit <NUM> may include at least one of a display module <NUM>, an audio output module <NUM> and a haptic output module <NUM>.

The display module <NUM> may output graphic objects corresponding to various types of information.

The display module <NUM> may include at least one of a liquid crystal display (LCD), a thin film transistor-LCD (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a three-dimensional (3D) display and an e-ink display.

The display module <NUM> may be inter-layered or integrated with a touch input module <NUM> to implement a touch screen.

The display module <NUM> may be implemented as a head up display (HUD). When the display module <NUM> is implemented as the HUD, the display module <NUM> may be provided with a projecting module so as to output information through an image which is projected on a windshield or a window.

The display module <NUM> may include a transparent display. The transparent display may be attached to the windshield or the window.

The transparent display may have a predetermined degree of transparency and output a predetermined screen thereon. The transparent display may include at least one of a thin film electroluminescent (TFEL), a transparent OLED, a transparent LCD, a transmissive transparent display and a transparent LED display. The transparent display may have adjustable transparency.

Meanwhile, the user interface apparatus <NUM> may include a plurality of display modules 251a to <NUM>.

The display module <NUM> may be disposed on one area of a steering wheel, one area 521a, 251b, 251e of an instrument panel, one area 251d of a seat, one area 251f of each pillar, one area <NUM> of a door, one area of a center console, one area of a headlining or one area of a sun visor, or implemented on one area 251c of a windshield or one area <NUM> of a window.

The audio output module <NUM> converts an electric signal provided from the processor <NUM> or the controller <NUM> into an audio signal for output. To this end, the audio output module <NUM> may include at least one speaker.

The haptic output module <NUM> generates a tactile output. For example, the haptic output module <NUM> may vibrate the steering wheel, a safety belt, a seat 110FL, 110FR, 110RL, 110RR such that the user can recognize such output.

The processor <NUM> may control an overall operation of each unit of the user interface apparatus <NUM>.

According to an embodiment, the user interface apparatus <NUM> may include a plurality of processors <NUM> or may not include any processor <NUM>.

When the processor <NUM> is not included in the user interface apparatus <NUM>, the user interface apparatus <NUM> may operate according to a control of a processor of another apparatus within the vehicle <NUM> or the controller <NUM>.

Meanwhile, the user interface apparatus <NUM> may be called as a display apparatus for vehicle.

The user interface apparatus <NUM> may operate according to the control of the controller <NUM>.

The object detecting apparatus <NUM> is an apparatus for detecting an object located at outside of the vehicle <NUM>.

The object may be a variety of objects associated with driving (operation) of the vehicle <NUM>.

Referring to <FIG> and <FIG>, an object O may include a traffic lane OB10, another vehicle OB11, a pedestrian OB12, a two-wheeled vehicle OB13, traffic signals OB14 and OB15, light, a road, a structure, a speed hump, a geographical feature, an animal and the like.

The lane OB01 may be a driving lane, a lane next to the driving lane or a lane on which another vehicle comes in an opposite direction to the vehicle <NUM>. The lanes OB10 may be a concept including left and right lines forming a lane.

The another vehicle OB11 may be a vehicle which is moving around the vehicle <NUM>. The another vehicle OB11 may be a vehicle located within a predetermined distance from the vehicle <NUM>. For example, the another vehicle OB11 may be a vehicle which moves before or after the vehicle <NUM>.

The pedestrian OB12 may be a person located near the vehicle <NUM>. The pedestrian OB12 may be a person located within a predetermined distance from the vehicle <NUM>. For example, the pedestrian OB12 may be a person located on a sidewalk or roadway.

The two-wheeled vehicle OB13 may refer to a vehicle (transportation facility) that is located near the vehicle <NUM> and moves using two wheels. The two-wheeled vehicle OB13 may be a vehicle that is located within a predetermined distance from the vehicle <NUM> and has two wheels. For example, the two-wheeled vehicle OB13 may be a motorcycle or a bicycle that is located on a sidewalk or roadway.

The traffic signals may include a traffic light OB15, a traffic sign OB14 and a pattern or text drawn on a road surface.

The light may be light emitted from a lamp provided on another vehicle, light generated from a streetlamp, or solar light.

The road may include a road surface, a curve, an upward slope, a downward slope and the like.

The structure may be an object that is located near a road and fixed on the ground. For example, the structure may include a streetlamp, a roadside tree, a building, an electric pole, a traffic light, a bridge and the like.

The geographical feature may include a mountain, a hill and the like.

Meanwhile, objects may be classified into a moving object and a fixed object. For example, the moving object may be a concept including another vehicle and a pedestrian. The fixed object may be a concept including a traffic signal, a road and a structure.

The object detecting apparatus <NUM> may include a camera <NUM>, a radar <NUM>, a LiDAR <NUM>, an ultrasonic sensor <NUM>, an infrared sensor <NUM> and a processor <NUM>.

According to an embodiment, the object detecting apparatus <NUM> may further include other components in addition to the components described, or may not include some of the components described.

The camera <NUM> may be located on an appropriate portion outside the vehicle to acquire an external image of the vehicle. The camera <NUM> may be a mono camera, a stereo camera 310a, an around view monitoring (AVM) camera 310b or a <NUM>-degree camera.

For example, the camera <NUM> may be disposed adjacent to a front windshield within the vehicle to acquire a front image of the vehicle. Or, the camera <NUM> may be disposed adjacent to a front bumper or a radiator grill.

For example, the camera <NUM> may be disposed adjacent to a rear glass within the vehicle to acquire a rear image of the vehicle. Or, the camera <NUM> may be disposed adjacent to a rear bumper, a trunk or a tail gate.

For example, the camera <NUM> may be disposed adjacent to at least one of side windows within the vehicle to acquire a side image of the vehicle. Or, the camera <NUM> may be disposed adjacent to a side mirror, a fender or a door.

The camera <NUM> may provide an acquired image to the processor <NUM>.

The radar <NUM> may include electric wave transmitting and receiving portions. The radar <NUM> may be implemented as a pulse radar or a continuous wave radar according to a principle of emitting electric waves. The radar <NUM> may be implemented in a frequency modulated continuous wave (FMCW) manner or a frequency shift Keyong (FSK) manner according to a signal waveform, among the continuous wave radar methods.

The radar <NUM> may detect an object in a time of flight (TOF) manner or a phase-shift manner through the medium of the electric wave, and detect a position of the detected object, a distance from the detected object and a relative speed with the detected object.

The radar <NUM> may be disposed on an appropriate position outside the vehicle for detecting an object which is located at a front, rear or side of the vehicle.

The LiDAR <NUM> may include laser transmitting and receiving portions. The LiDAR <NUM> may be implemented in a time of flight (TOF) manner or a phase-shift manner.

The LiDAR <NUM> may be implemented as a drive type or a non-drive type.

For the drive type, the LiDAR <NUM> may be rotated by a motor and detect object near the vehicle <NUM>.

For the non-drive type, the LiDAR <NUM> may detect, through light steering, objects which are located within a predetermined range based on the vehicle <NUM>. The vehicle <NUM> may include a plurality of non-drive type LiDARs <NUM>.

The LiDAR <NUM> may detect an object in a TOP manner or a phase-shift manner through the medium of a laser beam, and detect a position of the detected object, a distance from the detected object and a relative speed with the detected object.

The LiDAR <NUM> may be disposed on an appropriate position outside the vehicle for detecting an object located at the front, rear or side of the vehicle.

The ultrasonic sensor <NUM> may include ultrasonic wave transmitting and receiving portions. The ultrasonic sensor <NUM> may detect an object based on an ultrasonic wave, and detect a position of the detected object, a distance from the detected object and a relative speed with the detected object.

The ultrasonic sensor <NUM> may be disposed on an appropriate position outside the vehicle for detecting an object located at the front, rear or side of the vehicle.

The infrared sensor <NUM> may include infrared light transmitting and receiving portions. The infrared sensor <NUM> may detect an object based on infrared light, and detect a position of the detected object, a distance from the detected object and a relative speed with the detected object.

The infrared sensor <NUM> may be disposed on an appropriate position outside the vehicle for detecting an object located at the front, rear or side of the vehicle.

The processor <NUM> may control an overall operation of each unit of the object detecting apparatus <NUM>.

The processor <NUM> may detect an object based on an acquired image, and track the object. The processor <NUM> may execute operations, such as a calculation of a distance from the object, a calculation of a relative speed with the object and the like, through an image processing algorithm.

The processor <NUM> may detect an object based on a reflected electromagnetic wave which an emitted electromagnetic wave is reflected from the object, and track the object. The processor <NUM> may execute operations, such as a calculation of a distance from the object, a calculation of a relative speed with the object and the like, based on the electromagnetic wave.

The processor <NUM> may detect an object based on a reflected laser beam which an emitted laser beam is reflected from the object, and track the object. The processor <NUM> may execute operations, such as a calculation of a distance from the object, a calculation of a relative speed with the object and the like, based on the laser beam.

The processor <NUM> may detect an object based on a reflected ultrasonic wave which an emitted ultrasonic wave is reflected from the object, and track the object. The processor <NUM> may execute operations, such as a calculation of a distance from the object, a calculation of a relative speed with the object and the like, based on the ultrasonic wave.

The processor may detect an object based on reflected infrared light which emitted infrared light is reflected from the object, and track the object. The processor <NUM> may execute operations, such as a calculation of a distance from the object, a calculation of a relative speed with the object and the like, based on the infrared light.

According to an embodiment, the object detecting apparatus <NUM> may include a plurality of processors <NUM> or may not include any processor <NUM>. For example, each of the camera <NUM>, the radar <NUM>, the LiDAR <NUM>, the ultrasonic sensor <NUM> and the infrared sensor <NUM> may include the processor in an individual manner.

When the processor <NUM> is not included in the object detecting apparatus <NUM>, the object detecting apparatus <NUM> may operate according to the control of a processor of an apparatus within the vehicle <NUM> or the controller <NUM>.

The object detecting apparatus <NUM> may operate according to the control of the controller <NUM>.

The communication apparatus <NUM> is an apparatus for performing communication with an external device. Here, the external device may be another vehicle, a mobile terminal or a server.

The communication apparatus <NUM> may perform the communication by including at least one of a transmitting antenna, a receiving antenna, and radio frequency (RF) circuit and RF device for implementing various communication protocols.

The communication apparatus <NUM> may include a short-range communication unit <NUM>, a location information unit <NUM>, a V2X communication unit <NUM>, an optical communication unit <NUM>, a broadcast transceiver <NUM> and a processor <NUM>.

According to an embodiment, the communication apparatus <NUM> may further include other components in addition to the components described, or may not include some of the components described.

The short-range communication unit <NUM> is a unit for facilitating short-range communications. Suitable technologies for implementing such short-range communications include BLUETOOTH™, Radio Frequency IDentification (RFID), Infrared Data Association (IrDA), Ultra-WideBand (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, Wireless USB (Wireless Universal Serial Bus), and the like.

The short-range communication unit <NUM> may construct short-range area networks to perform short-range communication between the vehicle <NUM> and at least one external device.

The location information unit <NUM> is a unit for acquiring position information. For example, the location information unit <NUM> may include a Global Positioning System (GPS) module or a Differential Global Positioning System (DGPS) module.

The V2X communication unit <NUM> is a unit for performing wireless communications with a server (Vehicle to Infra; V2I), another vehicle (Vehicle to Vehicle; V2V), or a pedestrian (Vehicle to Pedestrian; V2P). The V2X communication unit <NUM> may include an RF circuit implementing a communication protocol with the infra (V2I), a communication protocol between the vehicles (V2V) and a communication protocol with a pedestrian (V2P).

The optical communication unit <NUM> is a unit for performing communication with an external device through the medium of light. The optical communication unit <NUM> may include a light-emitting diode for converting an electric signal into an optical signal and sending the optical signal to the exterior, and a photodiode for converting the received optical signal into an electric signal.

According to an embodiment, the light-emitting diode may be integrated with lamps provided on the vehicle <NUM>.

The broadcast transceiver <NUM> is a unit for receiving a broadcast signal from an external broadcast managing entity or transmitting a broadcast signal to the broadcast managing entity via a broadcast channel. The broadcast signal may include a TV broadcast signal, a radio broadcast signal and a data broadcast signal.

The processor <NUM> may control an overall operation of each unit of the communication apparatus <NUM>.

According to an embodiment, the communication apparatus <NUM> may include a plurality of processors <NUM> or may not include any processor <NUM>.

When the processor <NUM> is not included in the communication apparatus <NUM>, the communication apparatus <NUM> may operate according to the control of a processor of another device within the vehicle <NUM> or the controller <NUM>.

Meanwhile, the communication apparatus <NUM> may implement a display apparatus for a vehicle together with the user interface apparatus <NUM>. In this instance, the display apparatus for the vehicle may be referred to as a telematics apparatus or an Audio Video Navigation (AVN) apparatus.

The communication apparatus <NUM> may operate according to the control of the controller <NUM>.

The driving control apparatus <NUM> is an apparatus for receiving a user input for driving.

In a manual mode, the vehicle <NUM> may be operated based on a signal provided by the driving control apparatus <NUM>.

The driving control apparatus <NUM> may include a steering input device <NUM>, an acceleration input device <NUM> and a brake input device <NUM>.

The steering input device <NUM> may receive an input regarding a driving (ongoing) direction of the vehicle <NUM> from the user. The steering input device <NUM> is preferably configured in the form of a wheel allowing a steering input in a rotating manner. According to some embodiments, the steering input device may also be configured in a shape of a touch screen, a touchpad or a button.

The acceleration input device <NUM> may receive an input for accelerating the vehicle <NUM> from the user. The brake input device <NUM> may receive an input for braking the vehicle <NUM> from the user. Each of the acceleration input device <NUM> and the brake input device <NUM> is preferably configured in the form of a pedal. According to some embodiments, the acceleration input device or the brake input device may also be configured in a shape of a touch screen, a touchpad or a button.

The driving control apparatus <NUM> may operate according to the control of the controller <NUM>.

The vehicle operating apparatus <NUM> is an apparatus for electrically controlling operations of various devices within the vehicle <NUM>.

The vehicle operating apparatus <NUM> may include a power train operating unit <NUM>, a chassis operating unit <NUM>, a door/window operating unit <NUM>, a safety apparatus operating unit <NUM>, a lamp operating unit <NUM>, and an air-conditioner operating unit <NUM>.

According to some embodiments, the vehicle operating apparatus <NUM> may further include other components in addition to the components described, or may not include some of the components described.

Meanwhile, the vehicle operating apparatus <NUM> may include a processor. Each unit of the vehicle operating apparatus <NUM> may individually include a processor.

The power train operating unit <NUM> may control an operation of a power train device.

The power train operating unit <NUM> may include a power source operating portion <NUM> and a gearbox operating portion <NUM>.

The power source operating portion <NUM> may perform a control for a power source of the vehicle <NUM>.

For example, upon using a fossil fuel-based engine as the power source, the power source operating portion <NUM> may perform an electronic control for the engine. Accordingly, an output torque and the like of the engine can be controlled. The power source operating portion <NUM> may adjust the engine output torque according to the control of the controller <NUM>.

For example, upon using an electric energy-based motor as the power source, the power source operating portion <NUM> may perform a control for the motor. The power source operating portion <NUM> may adjust a rotating speed, a torque and the like of the motor according to the control of the controller <NUM>.

The gearbox operating portion <NUM> may perform a control for a gearbox.

The gearbox operating portion <NUM> may adjust a state of the gearbox. The gearbox operating portion <NUM> may change the state of the gearbox into drive (forward) (D), reverse (R), neutral (N) or parking (P).

Meanwhile, when an engine is the power source, the gearbox operating portion <NUM> may adjust a locked state of a gear in the drive (D) state.

The chassis operating unit <NUM> may control an operation of a chassis device.

The chassis operating unit <NUM> may include a steering operating portion <NUM>, a brake operating portion <NUM> and a suspension operating portion <NUM>.

The steering operating portion <NUM> may perform an electronic control for a steering apparatus within the vehicle <NUM>. The steering operating portion <NUM> may change a driving direction of the vehicle.

The brake operating portion <NUM> may perform an electronic control for a brake apparatus within the vehicle <NUM>. For example, the brake operating portion <NUM> may control an operation of brakes provided at wheels to reduce speed of the vehicle <NUM>.

Meanwhile, the brake operating portion <NUM> may individually control each of a plurality of brakes. The brake operating portion <NUM> may differently control braking force applied to each of a plurality of wheels.

The suspension operating portion <NUM> may perform an electronic control for a suspension apparatus within the vehicle <NUM>. For example, the suspension operating portion <NUM> may control the suspension apparatus to reduce vibration of the vehicle <NUM> when a bump is present on a road.

Meanwhile, the suspension operating portion <NUM> may individually control each of a plurality of suspensions.

The door/window operating unit <NUM> may perform an electronic control for a door apparatus or a window apparatus within the vehicle <NUM>.

The door/window operating unit <NUM> may include a door operating portion <NUM> and a window operating portion <NUM>.

The door operating portion <NUM> may perform the control for the door apparatus. The door operating portion <NUM> may control opening or closing of a plurality of doors of the vehicle <NUM>. The door operating portion <NUM> may control opening or closing of a trunk or a tail gate. The door operating portion <NUM> may control opening or closing of a sunroof.

The window operating portion <NUM> may perform the electronic control for the window apparatus. The window operating portion <NUM> may control opening or closing of a plurality of windows of the vehicle <NUM>.

The safety apparatus operating unit <NUM> may perform an electronic control for various safety apparatuses within the vehicle <NUM>.

The safety apparatus operating unit <NUM> may include an airbag operating portion <NUM>, a seatbelt operating portion <NUM> and a pedestrian protecting apparatus operating portion <NUM>.

The airbag operating portion <NUM> may perform an electronic control for an airbag apparatus within the vehicle <NUM>. For example, the airbag operating portion <NUM> may control the airbag to be deployed upon a detection of a risk.

The seatbelt operating portion <NUM> may perform an electronic control for a seatbelt apparatus within the vehicle <NUM>. For example, the seatbelt operating portion <NUM> may control passengers to be motionlessly seated in seats 110FL, 110FR, 110RL, 110RR using seatbelts upon a detection of a risk.

The pedestrian protecting apparatus operating portion <NUM> may perform an electronic control for a hood lift and a pedestrian airbag. For example, the pedestrian protecting apparatus operating portion <NUM> may control the hood lift and the pedestrian airbag to be open up upon detecting pedestrian collision.

The lamp operating unit <NUM> may perform an electronic control for various lamp apparatuses within the vehicle <NUM>.

The air-conditioner operating unit <NUM> may perform an electronic control for an air conditioner within the vehicle <NUM>. For example, the air-conditioner operating unit <NUM> may control the air conditioner to supply cold air into the vehicle when internal temperature of the vehicle is high.

The vehicle operating apparatus <NUM> may include a processor. Each unit of the vehicle operating apparatus <NUM> may individually include a processor.

The vehicle operating apparatus <NUM> may operate according to the control of the controller <NUM>.

The operation system <NUM> is a system that controls various driving modes of the vehicle <NUM>. The operation system <NUM> may include a driving system <NUM>, a parking exit system <NUM> and a parking system <NUM>.

According to embodiments, the operation system <NUM> may further include other components in addition to components to be described, or may not include some of the components to be described.

Meanwhile, the operation system <NUM> may include a processor. Each unit of the operation system <NUM> may individually include a processor.

According to embodiments, the operation system may be a sub concept of the controller <NUM> when it is implemented in a software configuration.

Meanwhile, according to embodiment, the operation system <NUM> may be a concept including at least one of the user interface apparatus <NUM>, the object detecting apparatus <NUM>, the communication apparatus <NUM>, the vehicle operating apparatus <NUM> and the controller <NUM>.

The driving system <NUM> may perform driving of the vehicle <NUM>.

The driving system <NUM> may receive navigation information from a navigation system <NUM>, transmit a control signal to the vehicle operating apparatus <NUM>, and perform driving of the vehicle <NUM>.

The driving system <NUM> may receive object information from the object detecting apparatus <NUM>, transmit a control signal to the vehicle operating apparatus <NUM> and perform driving of the vehicle <NUM>.

The driving system <NUM> may receive a signal from an external device through the communication apparatus <NUM>, transmit a control signal to the vehicle operating apparatus <NUM>, and perform driving of the vehicle <NUM>.

The parking exit system <NUM> may perform an exit of the vehicle <NUM> from a parking lot.

The parking exit system <NUM> may receive navigation information from the navigation system <NUM>, transmit a control signal to the vehicle operating apparatus <NUM>, and perform the exit of the vehicle <NUM> from the parking lot.

The parking exit system <NUM> may receive object information from the object detecting apparatus <NUM>, transmit a control signal to the vehicle operating apparatus <NUM> and perform the exit of the vehicle <NUM> from the parking lot.

The parking exit system <NUM> may receive a signal from an external device through the communication apparatus <NUM>, transmit a control signal to the vehicle operating apparatus <NUM>, and perform the exit of the vehicle <NUM> from the parking lot.

The parking system <NUM> may perform parking of the vehicle <NUM>.

The parking system <NUM> may receive navigation information from the navigation system <NUM>, transmit a control signal to the vehicle operating apparatus <NUM>, and park the vehicle <NUM>.

The parking system <NUM> may receive object information from the object detecting apparatus <NUM>, transmit a control signal to the vehicle operating apparatus <NUM> and park the vehicle <NUM>.

The parking system <NUM> may receive a signal from an external device through the communication apparatus <NUM>, transmit a control signal to the vehicle operating apparatus <NUM>, and park the vehicle <NUM>.

The navigation system <NUM> may provide navigation information. The navigation information may include at least one of map information, information regarding a set destination, path information according to the set destination, information regarding various objects on a path, lane information and current location information of the vehicle.

The navigation system <NUM> may include a memory and a processor. The memory may store the navigation information. The processor may control an operation of the navigation system <NUM>.

According to embodiments, the navigation system <NUM> may update prestored information by receiving information from an external device through the communication apparatus <NUM>.

According to embodiments, the navigation system <NUM> may be classified as a sub component of the user interface apparatus <NUM>.

The sensing unit <NUM> may sense a status of the vehicle. The sensing unit <NUM> may include a posture sensor (e.g., a yaw sensor, a roll sensor, a pitch sensor, etc.), a collision sensor, a wheel sensor, a speed sensor, a tilt sensor, a weight-detecting sensor, a heading sensor, a gyro sensor, a position module, a vehicle forward/backward movement sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by a turn of a handle, a vehicle internal temperature sensor, a vehicle internal humidity sensor, an ultrasonic sensor, an illumination sensor, an accelerator position sensor, a brake pedal position sensor, and the like.

The sensing unit <NUM> may acquire sensing signals with respect to vehicle-related information, such as a posture, a collision, an orientation, a position (GPS information), an angle, a speed, an acceleration, a tilt, a forward/backward movement, a battery, a fuel, tires, lamps, internal temperature, internal humidity, a rotated angle of a steering wheel, external illumination, pressure applied to an accelerator, pressure applied to a brake pedal and the like.

The sensing unit <NUM> may further include an accelerator sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an air temperature sensor (ATS), a water temperature sensor (WTS), a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), and the like.

The interface unit <NUM> may serve as a path allowing the vehicle <NUM> to interface with various types of external devices connected thereto. For example, the interface unit <NUM> may be provided with a port connectable with a mobile terminal, and connected to the mobile terminal through the port. In this instance, the interface unit <NUM> may exchange data with the mobile terminal.

Meanwhile, the interface unit <NUM> may serve as a path for supplying electric energy to the connected mobile terminal. When the mobile terminal is electrically connected to the interface unit <NUM>, the interface unit <NUM> supplies electric energy supplied from a power supply unit <NUM> to the mobile terminal according to the control of the controller <NUM>.

The memory <NUM> is electrically connected to the controller <NUM>. The memory <NUM> may store basic data for units, control data for controlling operations of units and input/output data. The memory <NUM> may be a variety of storage devices, such as ROM, RAM, EPROM, a flash drive, a hard drive and the like in a hardware configuration. The memory <NUM> may store various data for overall operations of the vehicle <NUM>, such as programs for processing or controlling the controller <NUM>.

According to embodiments, the memory <NUM> may be integrated with the controller <NUM> or implemented as a sub component of the controller <NUM>.

The controller <NUM> may control an overall operation of each unit of the vehicle <NUM>. The controller <NUM> may be referred to as an Electronic Control Unit (ECU).

The power supply unit <NUM> may supply power required for an operation of each component according to the control of the controller <NUM>. Specifically, the power supply unit <NUM> may receive power supplied from an internal battery of the vehicle, and the like.

At least one processor and the controller <NUM> included in the vehicle <NUM> may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro controllers, microprocessors, and electric units performing other functions.

Meanwhile, the vehicle <NUM> related to the present disclosure may include a vehicle control device <NUM>.

The vehicle control device <NUM> may control at least one of the components described above with reference to <FIG>. In this point of view, the vehicle control device <NUM> may be the controller <NUM>.

However, without being limited thereto, the vehicle control device <NUM> may be a separate component independent from the controller <NUM>. When the vehicle control device <NUM> is implemented as a component independent from the controller <NUM>, the vehicle control device <NUM> may be provided in a portion of the vehicle <NUM>.

Hereinafter, for the purposes of description, it is assumed that the vehicle control device <NUM> is a separate component independent from the controller <NUM>. Functions (operations) and control method described with respect to the vehicle control device <NUM> may be performed by the controller <NUM> of a vehicle. That is, all contents described in relation to the vehicle control device <NUM> may also be inferred and applied to the controller <NUM> in the same or similar manner.

Also, the vehicle control device <NUM> described in this disclosure may include the components described above with reference to <FIG> and some of various components provided in the vehicle. In this disclosure, for the purposes of description, the components described above with reference to <FIG> and some of various components provided in the vehicle will be given separate names and reference numerals and described accordingly.

Hereinafter, a vehicle control device and a method thereof according to an embodiment of the present disclosure will be described with reference to the accompanying drawings.

<FIG> is a block diagram illustrating an embodiment of a vehicle control device according to the present disclosure.

Referring to <FIG>, a vehicle control device <NUM> according to the present disclosure, which controls a vehicle <NUM> having a display unit <NUM>, includes a communication unit <NUM> and a controller <NUM>.

As described above, the display unit <NUM> be implemented in one area of the steering wheel, one area of the instrument panel 521a, 251b, and 251e, one area 251d of the seat, one area 251f of each filler, one area <NUM> of the door, one area of the center console, one area of the head lining, one area of the sun visor, one area 251c of the windshield, and one area <NUM> of the window.

The communication unit <NUM> receives a plurality of images from an external device.

The communication unit <NUM> is configured to perform communication with the various components described in <FIG>. For example, the communication unit <NUM> may receive various information provided through the may (controller area network).

In another example, the communication unit <NUM> may perform communication with all devices capable of performing communication, such as a mobile terminal, a server, and another vehicle. This may be called V2X (Vehicle to everything) communication. V2X communication may be defined as technology that exchanges information such as traffic situation, or the like, while communicating with road infrastructure and another vehicle while driving.

Vehicle to Vehicle (V2V) communication may be understood as an example of V2X communication or as a concept included in V2X communication. That is, the communication unit <NUM> may perform communication with a nearby vehicle (or another vehicle). This may be named V2V communication. V2V communication may be generally defined as a technique for exchanging information between vehicles, and it is possible to share position information, speed information, and the like, of nearby vehicles.

In an embodiment, the external device may include a mobile terminal, a fixed terminal, a server, and the like. Specifically, the mobile terminal may include a mobile phone, a smartphone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC, a tablet PC, an ultrabook, a wearable device (e.g., a smartwatch, a glass type terminal, a head mounted display (HMD)), and the like.

The fixed terminal may include a digital TV, a desktop computer, a digital signage, and the server may include a cloud server and a management server.

The plurality of images may include image files in various formats such as a shot image, a captured or downloaded image, and the like. For example, a photo album image selected by the user of the terminal (external device) may be received through the communication unit <NUM>.

The controller <NUM> extracts a corresponding destination regarding each of the plurality of images and controls the communication unit <NUM> to guide the extracted destination through the display unit <NUM>.

As an embodiment, a first destination may be extracted from a first image, one of the plurality of images. Accordingly, a screen for guiding the first destination may be output on the display unit <NUM>. Specifically, information about the first destination may be output, or a driving route to the first destination may be output.

Also, when a plurality of destinations are extracted, the controller <NUM> may generate a group for each destination and control the communication unit <NUM> such that at least one of a plurality of images is classified according to the generated groups so as to be displayed.

In an embodiment, the plurality of images may include first and second images, and the controller <NUM> may extract a first destination corresponding to the first image and a second destination corresponding to the second image.

Accordingly, the first image may be included in a group of the first destination, and the second image may be included in a group of the second destination.

In another embodiment, the first destination and at least one image included in the group of the first destination are displayed in a first area of the display unit <NUM>, and the second destination and at least one image included in the group of the second destination may be displayed in a second area of the display unit <NUM>.

Meanwhile, the control unit (<NUM>) is implemented by at least one processor.

<FIG> is a flow chart illustrating an embodiment of a control method of a vehicle according to the present disclosure.

Referring to <FIG>, in a method for controlling the vehicle <NUM> having the display unit <NUM>, first, a plurality of images are received from an external device (S910).

Next, a destination corresponding to each of the plurality of images is extracted (S920).

The destination corresponding to each of the images may be extracted by various image analysis techniques. In an embodiment, the images may be analyzed and determined which types of images they are, such as a place image, a human image, a food image, and the like.

If it is a place image, a corresponding place may be extracted as a destination. In another example, in the case of a food or object image, a place where the food or the object is sold may be extracted as a destination. Similarly, in the case of a human image, an address or current position of a corresponding person may be extracted as a destination.

In another embodiment, a destination may be extracted using information stored in a specific application or memory. Specifically, when a food image is received, a place where the corresponding food is sold, stored in a predetermined application may be extracted as a destination.

In another embodiment, a place, time, and the like, may be extracted from text information of the image, or a predetermined destination may be extracted from metadata of the image.

In another embodiment, a message asking whether extraction of the destination corresponding to the image is proper may be transmitted to an external device or may be output on the display unit <NUM>.

Thereafter, the extracted destination is guided through the display unit <NUM> (S930).

In an embodiment, the guiding step includes a step S930 in which when a plurality of extracted destinations are extracted, groups are generated by destinations, and at least one of the plurality of images is classified and displayed according to the generated groups.

In a specific embodiment, the plurality of images include first and second images, and the step of extracting the destination (S920) may include a step of extracting a first destination corresponding to the first image and a second destination corresponding to the second image.

In another embodiment, the guiding step S930 may include a step in which the first destination and at least one image included in the group of the first destination are displayed in a first area and the second destination and at least one image included in the group of the second destination are displayed in a second area of the display unit <NUM>.

In another embodiment, the step of extracting the destination (S920) may include inserting the information on the first destination into the metadata of the first image, and inserting the metadata of the second image into the metadata of the second image and inserting the information.

In another embodiment, the step <NUM> of extracting the destination may include inserting information regarding the first destination into meta data of the first image and inserting information regarding the second destination into meta data of the second image.

<FIG> is a conceptual view illustrating an embodiment in which a plurality of images are transmitted from an external device.

Referring to <FIG>, a user of a mobile terminal <NUM> may select some photo images from a photo album and transmit the selected images to the vehicle <NUM>.

Accordingly, the received photo images may be output on the display <NUM> of the vehicle <NUM>. Specifically, a predetermined destination may be extracted from the received photo images, and in case where a plurality of destinations are extracted, groups may be generated by destinations. Accordingly, each of the received photo images may be included in a group of extracted destinations and output.

Thereafter, the extracted destination information may be transmitted to the mobile terminal <NUM>. Accordingly, the mobile terminal <NUM> may output the photo images forming groups according to destinations.

Here, information on the extracted destination corresponding to each of the photo images may be inserted as metadata into each of the photo images. For example, when a first destination is extracted to correspond to the first image, information about the first destination may be inserted into metadata of the first image. As a result, in the mobile terminal <NUM>, it may be checked that the first image belongs to the group of the first destination (the first destination is extracted from the first image).

In another example, the vehicle control device <NUM> may receive metadata together with a photo image from a server <NUM>.

That is, the vehicle control device <NUM> may directly extract a destination from the photo image received from the mobile terminal <NUM> or may receive a photo image in which a destination is inserted as meta data, from the server <NUM>.

Meanwhile, the plurality of images include first and second images, and the controller <NUM> may extract a first destination corresponding to the first image and a second destination corresponding to the second image.

In another embodiment, the controller <NUM> may insert information about the first destination into the meta data of the first image and insert the information about the second destination into the meta data of the second image.

Accordingly, the controller <NUM> may control the communication unit <NUM> to transmit the metadata of the first and second images to the external device.

In another embodiment, the plurality of images include a third image, and when the first destination is extracted to correspond to the third image, the controller <NUM> may include the first image and the third image in the group of the first destination.

In another embodiment, the plurality of images may include a fourth image, and when a plurality of destinations are extracted to correspond to the fourth image, the controller <NUM> may include the fourth image in a group of a destination satisfying a predetermined condition among the plurality of destinations.

In a specific example, the controller <NUM> includes the fourth image in a group of destinations having a largest number of corresponding images among the plurality of destinations.

<FIG> is a conceptual view illustrating an embodiment in which a destination is extracted from a plurality of images.

Referring to <FIG>, a first destination is extracted from the first and third images, and a second destination is extracted from the second image. The third and fourth destinations is extracted from the fourth image.

Accordingly, the first and third images from which the same destination is extracted is included in the group of the first destination. And, the second image is included in the group of the second destination.

The fourth image from which a plurality of destinations are extracted may be included in the group of the third destination or the group of the fourth destination. In an embodiment, a group to which the fourth image belongs is determined by comparing the number of images belonging to the group of the third destination with the number of images belonging to the group of the fourth destination. In detail, when the number of images belonging to the group of the third destination is larger than the number of images belonging to the group of the fourth destination, the fourth is included in the group of the third destination.

In another embodiment, information on each extracted destination may be inserted into metadata of the image. Specifically, information on the first destination may be inserted into each of metadata of first and third images, and information on the second destination may be inserted into metadata of the second image.

In addition, information on at least one destination selected from the third and fourth destinations may be inserted into metadata of the fourth image.

In another embodiment, the metadata for each image may be transmitted to an external device. In a specific example, the metadata may be transmitted to the mobile terminal <NUM> or the server <NUM> described in <FIG>.

Meanwhile, the first destination and at least one image included in the group of the first destination may be displayed in a first area of the display unit <NUM> and the second destination and at least one image included in the group of the second destination may be displayed in a second area of the display unit <NUM>.

<FIG> is a conceptual view illustrating an embodiment in which a plurality of images are classified as groups of destinations and displayed.

Referring to <FIG>, images are classified and displayed by groups of destinations.

As an embodiment continued from <FIG>, the first and third images may be included in the group of the first destination and output.

Here, the first and third images may be output in an overlapping manner, and here, a frequently transmitted image or a recently transmitted image may be displayed as a representative image.

In another example, each size may be reduced so that the first and third images may all be seen in the group of the first destination.

Similarly, a second image may be output to the group of the second destination and the fourth image may be output to the group of the third destination.

Meanwhile, when the number of images included in the group of the first destination is equal to or greater than a predetermined number, the controller <NUM> may calculate priority of the first destination to be higher than other destinations.

In an embodiment, priority may be calculated to be different depending on the number of images included in each group. For example, when the number of images included in the group of the first destination is larger than the number of images included in the group of the second destination, priority for the first destination is calculated to be higher than the priority for the second destination.

Priority may be applied on the basis of several references. For example, if priority of an image is high, an output order thereof on the list of the groups by destinations may come on ahead or the image may be output in the middle of the screen <NUM>.

In a specific example, if the priority for the first destination is higher than the priority for the second destination, the group of the first destination may be output in the middle of the screen <NUM>. In another example, a graphic object (such as an icon, etc.) indicating a high priority may be displayed in the group of the first destination.

Meanwhile, the controller <NUM> may further search for a similar destination using the first destination.

The similar destination is a place similar to the first destination, and may be variously defined according to a predetermined reference. For example, if the first destination is a mart, similar destinations may include marts at different locations. Similarly, if the first destination is an amusement park, amusement parks at different locations may be included in the similar destination.

In another embodiment, when the vehicle <NUM> is traveling to a final destination, rather than the first destination, the controller <NUM> may search the similar destination on the route to the final destination.

In another embodiment, the similar destination may be searched within a predetermined radius based on a current position of the vehicle <NUM>.

<FIG> is a conceptual view illustrating an embodiment in which a similar destination regarding a destination is additionally searched.

Referring to <FIG>, when the number of images included in the group of the first destination is equal to or greater than a predetermined number, the priority for the first destination may be set to be higher than other destinations. In addition, similar destinations may be further searched using the first destination.

In an embodiment, when the vehicle <NUM> travels along a predetermined driving route, a similar destination may be searched on the driving route. Accordingly, when a similar destination is searched, a location of the similar destination may be displayed on the driving route.

In addition, a message window indicating that the similar destination exists may be output, or a notification message may be output by voice.

Meanwhile, the controller <NUM> may calculate the driving route using the first and second destinations, and may control the communication unit <NUM> so that the calculated driving route is output on the display unit <NUM>.

In an embodiment, the controller <NUM> may control the communication unit <NUM> such that a thumbnail of the first image is output to a position corresponding to the first destination on the driving route and a thumbnail of the second image is output to a position corresponding to the second destination on the driving route.

In another embodiment, when the driving route is calculated, the controller <NUM> may determine a running order for the first and second destinations according to the number of images included in the groups of the first and second destinations.

<FIG> is a conceptual view illustrating an embodiment in which a driving route calculated using a destination is output.

Referring to <FIG>, when a first destination is extracted to correspond to a first image and a second destination is extracted to correspond to a second image, a driving route <NUM> passing through the first and second destinations may be calculated.

In an embodiment, a driving route passing through the first and second destinations may be calculated in consideration of a current position of the vehicle <NUM>, a traffic situation, a frequently traveled route, and the like.

In another embodiment, a running order for the first and second destinations may be determined according to the number of images included in each of the groups of first and second destinations. In a specific example, when the number of images included in the group of the first destination is greater than the number of images included in the group of the second destination, the driving route <NUM> that first passes through the first destination and subsequently passes through the second destination may be calculated.

In addition, the calculated travel route <NUM> may be output on the display unit <NUM>, and the positions of the first and second destinations may be displayed on the travel route <NUM>. Also, a thumbnail <NUM> of the first image may be output at the position of the first destination, and a thumbnail <NUM> of the second image may be output at the position of the second destination.

In another embodiment, a thumbnail image output to a position of the destination on the driving route may be the most recently received image or an image with high transmission frequency. In a specific example, the first destination may be extracted from the first image, the third image, and the fourth image. Here, if the first image has most recently been transmitted, a thumbnail of the first image may be output to the position of the first destination.

<FIG> is a conceptual view illustrating an embodiment in which a plurality of driving routes are output.

Referring to <FIG>, an occupant may select at least one of groups by destinations. In an embodiment, the occupant may apply a touch to a group of destinations A, C, and D to select the destinations A, C and D. Here, a check mark may be displayed in check boxes of the group of destinations A, C, and D.

In another embodiment, several driving routes passing through the selected destinations A, C, and D may be calculated and displayed on the display unit <NUM>.

As described above, the driving routes may be variously calculated in consideration of the number of images included in each destination, a current location of the vehicle, traffic conditions, routes that the driver has frequently traveled, time, weather, driver preference, stopover, and the like.

In a specific example, if the number of images included in the destination A is largest and the number of images included in the destination D is smallest, a running order may be set to a running order of destinations A, C, and D.

The driver may select a driving route <NUM>, among several driving routes, by applying a touch input, and the vehicle <NUM> may travel along the driving route <NUM>.

In an example, thumbnails <NUM>, <NUM> and <NUM> of images corresponding to the destinations A, C and D may be output in the selected driving route <NUM>. Here, the thumbnails <NUM>, <NUM>, and <NUM> of the images may be representative images for respective destinations.

In a specific example, each of the representative images for the destinations may be a most recently received image or an image which has been repeatedly received several times for each destination. Or, each of the representative images may be an image having the highest image quality among the images belonging to the group of the destinations.

When the vehicle <NUM> is turned on, the controller <NUM> may control the communication unit <NUM> such that a plurality of images may be received from a terminal that satisfies a predetermined condition among a plurality of terminals located in the vehicle <NUM>.

In an embodiment, the controller <NUM> may control the communication unit <NUM> such that a plurality of images are received from the terminal of the driver on the basis of information identifying the driver of the vehicle <NUM>.

<FIG> is a conceptual view illustrating an embodiment in which a plurality of images are received from a terminal of a driver.

Referring to <FIG>, when the vehicle <NUM> is turned on and a plurality of terminals <NUM> and <NUM> in the vehicle <NUM> are detected, a plurality of images may be preferentially received from the terminal <NUM> of the driver.

In an embodiment, the driver's face may be recognized from an image obtained by imaging the inside of the vehicle <NUM>. Accordingly, a plurality of images may be received from the terminal <NUM> registered to be owned by the driver.

Hereinafter, an embodiment of selecting an image to be transmitted from an external device and a vehicle to be transmitted will be described with reference to the accompanying drawings.

<FIG> and <FIG> are conceptual views illustrating an embodiment of selecting an image to be transmitted.

Referring to <FIG>, while using various applications such as a search portal, a map, a messenger, and a calendar, and the like, the mobile terminal <NUM> may transmit contents to the vehicle <NUM> in a sharing manner.

In an embodiment, when a share menu is selected, a menu item <NUM> for transmitting contents to the vehicle may be output. Accordingly, when a touch input is applied to the menu item <NUM>, the corresponding contents may be transmitted to the vehicle <NUM>.

Referring to <FIG>, the user of the mobile terminal <NUM> may select an image to be transmitted among photo album images, and then select the share menu.

Accordingly, the menu item <NUM> for transmitting contents to the vehicle may be output, and when a touch input is applied to the menu item <NUM>, the selected photo image may be transmitted to the vehicle <NUM>.

<FIG> is a conceptual view illustrating an embodiment of selecting a vehicle to be transmitted.

Referring to <FIG>, when the menu item <NUM> for transmitting contents to the vehicle is selected, a list <NUM> of vehicles that may be transmitted may be output.

In an example, the list <NUM> may include a previously registered vehicle, a vehicle located within a predetermined distance, and the like.

In a specific example, when a touch input is applied to an item of a first vehicle, selected contents may be transmitted to the first vehicle. Here, the contents may be transmitted at the time when the first vehicle is started. In another example, contents may be transmitted in a chat window with the first vehicle.

In another example, the list <NUM> may include a server. When a touch input is applied to a server item, contents may be transmitted to the server. Thereafter, when a vehicle is detected within a predetermined distance from the terminal, a message inquiring whether to transmit the contents to the vehicle may be output. An embodiment related thereto will be described with reference to <FIG>.

In another example, an item for registering a new vehicle may be output on the list <NUM>. Accordingly, a new vehicle for transmission may be added by applying a touch input to the item for registering a new vehicle.

In another embodiment, all or only some of a plurality of images may be transmitted depending on the type of vehicle to which the images are to be transmitted.

In a specific example, if the vehicle to which an image is to be transmitted is an own vehicle, a plurality of images may all be transmitted. Alternatively, if the vehicle to which an image is to be transmitted is not the own vehicle, only some of the plurality of images may be transmitted. If the vehicle to which an image is to be transmitted is a public transportation means such as a taxi, only a limited image may be transmitted.

Hereinafter, an embodiment in which the vehicle output to the list <NUM> is set will be described.

In an embodiment, a frequently used vehicle (self-owned vehicle, family owned vehicle, etc.) may be directly registered in advance through a vehicle type, a vehicle number, and the like. To this end, a user authentication process may be performed.

In another example, when a person who carries a terminal gets in the vehicle, the terminal may recognize the corresponding vehicle and a frequently used vehicle may be automatically registered. Alternatively, if a shared car is used, vehicle information may be retrieved from an shared vehicle application and registered.

<FIG> is a conceptual view illustrating an embodiment in which a plurality of images are transmitted to a vehicle which has approached a terminal from a server.

Referring to <FIG>, in the embodiment of <FIG>, when the server is selected from the list <NUM>, selected contents may be preferentially transmitted to the server.

Thereafter, when a vehicle is detected within a predetermined distance from the terminal <NUM>, a message inquiring whether to transmit contents to the vehicle may be output. Accordingly, when transmission is accepted, the contents may be transmitted to the corresponding vehicle.

Hereinafter, in a further embodiment, information calculated through image analysis and information using an in-vehicle image may be inserted into metadata of the image and used in other terminals.

In an embodiment, when a movie poster is received, a corresponding movie may be played in the vehicle. If the occupant is sleepy or bored while the movie is being played, a movie similar to the movie may not be recommended any longer.

Effects of the vehicle control device provided in a vehicle and the method for controlling a vehicle according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, a destination and a driving route may be automatically proposed by simply transmitting an image, without having to directly input the destination.

Also, by inserting the destination extracted from the image into metadata of the image, destination information related to the image may also be used even in another device or an external server.

In addition, by displaying a thumbnail of the image corresponding to the destination at a position of the destination on the driving route, the position of the destination extracted from the image may be checked by intuition.

The present invention described above may be implemented as a computer-readable code in a medium in which a program is recorded. The computer-readable medium includes any type of recording device in which data that may be read by a computer system is stored. The computer-readable medium may be, for example, a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. The computer-readable medium also includes implementations in the form of carrier waves (e.g., transmission via the Internet). Also, the computer may include the controller <NUM> of the terminal. Thus, the foregoing detailed description should not be interpreted limitedly in every aspect and should be considered to be illustrative. The scope of the present invention should be determined by reasonable interpretations of the attached claims and every modification within the scope of these claims are included in the scope of the present invention.

The foregoing embodiments and advantages are merely exemplary and are not to be considered as limiting the present disclosure. The present teachings may be readily applied to other types of apparatuses. This description is intended to be illustrative, and not to limit the scope of the claims. Many alternatives, modifications, and variations will be apparent to those skilled in the art. The features, structures, methods, and other characteristics of the exemplary embodiments described herein may be combined in various ways to obtain additional and/or alternative exemplary embodiments.

Claim 1:
A control device (<NUM>) for use in a vehicle (<NUM>), the vehicle (<NUM>) including a display unit (<NUM>), the control device (<NUM>) comprising:
a communication unit (<NUM>) configured to receive a plurality of images from an external device; and
at least one processor (<NUM>) configured to:
identify destinations that correspond to the plurality of images, respectively,
generate one or more groups comprising one or more of the identified destinations and control the communication unit (<NUM>) such that the plurality of images is classified according to the generated one or more groups, and
control the display unit (<NUM>) to display at least one of the plurality of images that correspond to the one or more of the identified destinations and that are included in the generated one or more groups,
wherein the at least one processor (<NUM>) is further configured to:
identify a plurality of destinations corresponding to a specific image included in the plurality of images, and
determine a group of the one or more groups corresponding to the plurality of destinations by comparing a number of corresponding images and selecting a destination having a largest number of corresponding images among the plurality of destinations.