Source: https://patents.google.com/patent/JPWO2017047176A1/en
Timestamp: 2020-01-24 15:46:51
Document Index: 527225333

Matched Legal Cases: ['art 110', 'art 1101', 'art 1102', 'art 1103', 'art 1104', 'art 120', 'art 1201', 'art 1202', 'art 1203', 'art 130', 'art 1301']

JPWO2017047176A1 - Information processing apparatus, information processing method, and program - Google Patents
JPWO2017047176A1
JPWO2017047176A1 JP2016067568A JP2017539715A JPWO2017047176A1 JP WO2017047176 A1 JPWO2017047176 A1 JP WO2017047176A1 JP 2016067568 A JP2016067568 A JP 2016067568A JP 2017539715 A JP2017539715 A JP 2017539715A JP WO2017047176 A1 JPWO2017047176 A1 JP WO2017047176A1
JP2016067568A
河本　献太
井手　直紀
直紀 井手
慎吾 高松
2015-09-18 Priority to JP2015185362 priority Critical
2015-09-18 Priority to JP2015185362 priority
2016-06-13 Application filed by ソニー株式会社 filed Critical ソニー株式会社
2016-06-13 Priority to PCT/JP2016/067568 priority patent/WO2017047176A1/en
2018-06-28 Publication of JPWO2017047176A1 publication Critical patent/JPWO2017047176A1/en
238000004891 communication Methods 0 claims description 114
210000003733 Optic Disk Anatomy 0 description 10
An information processing apparatus, an information processing method, and a program capable of effectively using information related to user evaluation for a target vehicle are provided.
A recognition unit for automatically recognizing information on a target vehicle from user environment information, an acquisition unit for acquiring a user evaluation for the recognized target vehicle, and information for notifying the acquired user evaluation. An information processing apparatus comprising: a generating unit that generates the information.
When the car penetration rate rises and many people use cars on a daily basis, problems such as eliminating traffic congestion, preventing car accidents, and improving driving manners become problems.
For example, in Patent Document 1 below, in order to increase motivation for improving driving manners, behavior (hazard, horn, etc.) that evaluates driving manners addressed to the vehicle by others is acquired and transmitted to the server. A system for calculating points according to driving evaluation information is described.
In recent years, in-vehicle information presentation apparatuses that present various information such as traffic jam information and navigation information to users have become widespread. For example, Patent Document 2 below describes an in-vehicle information presentation device that displays an energy consumption state of an in-vehicle battery of another vehicle on a map screen together with the current position of the other vehicle.
JP 2012-150557 A JP 2012-207941 A
Here, in the technique described in Patent Document 1, motivation for improving driving manners is enhanced by showing the user himself / herself the point information corresponding to the user's driving evaluation information, but his own evaluation is confirmed. Just doing it is not enough to motivate you to drive well. In the technique described in Patent Document 2, the energy consumption state of the on-vehicle battery of another vehicle can be confirmed. However, for prevention of accidents and comfortable driving, evaluation on driving manners of other vehicles traveling around the vehicle is possible. Is also important.
Therefore, the present disclosure proposes an information processing apparatus, an information processing method, and a program that can effectively use information related to user evaluation for a target vehicle.
According to the present disclosure, a recognition unit that automatically recognizes information on a target vehicle from user environment information, an acquisition unit that acquires a user evaluation for the recognized target vehicle, and a notification for the acquired user evaluation An information processing apparatus including a generation unit that generates information is proposed.
According to the present disclosure, a processor automatically recognizes information on a target vehicle from user environment information, acquires a user evaluation for the recognized target vehicle, and notifies the acquired user evaluation. Proposing an information processing method including generating
According to the present disclosure, the computer notifies the recognition unit that automatically recognizes the information on the target vehicle from the user's environment information, the acquisition unit that acquires the user evaluation for the recognized target vehicle, and the acquired user evaluation. We propose a program for functioning as a generation unit that generates information to be used.
As described above, according to the present disclosure, it is possible to effectively use information related to user evaluation for the target vehicle.
Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.
It is a figure explaining an outline of an information processing system by one embodiment of this indication. It is a figure which shows an example of the basic composition of the information processing apparatus by this embodiment. It is a figure which shows an example of the detailed structure of the information processing apparatus by this embodiment. It is a figure explaining an example of the recognition method of the object vehicle by this embodiment. It is a flowchart which shows the evaluation input process to the other vehicle by 1st Embodiment. It is a figure explaining the example of a display when notification of user evaluation is performed in the object vehicle by a 1st embodiment. It is a flowchart which shows the display process of the evaluation information of the other vehicle by 1st Embodiment. It is a figure explaining the case where the evaluation information of other vehicles of the circumference by a 1st embodiment is displayed. It is a figure explaining the case where the evaluation information of the other vehicle which drive | works the periphery by 1st Embodiment is displayed on a TopView screen. It is a figure explaining the case where the evaluation information of the object vehicle by 1st Embodiment is negative. It is a flowchart which shows the display process of the speed information of the other vehicle by 2nd Embodiment. It is a figure explaining the case where the speed information of other vehicles of the circumference by a 2nd embodiment is displayed. It is a figure explaining the case where the speed information of the other vehicle which drive | works the periphery by 2nd Embodiment is displayed on a TopView screen. It is a figure explaining the case where the speed information of the other vehicle which drive | works the periphery by 2nd Embodiment is displayed on a Bird View screen. It is a figure explaining the information acquisition route from the other vehicles by a 2nd embodiment. It is a figure which shows the list of the speed information of the surrounding vehicle which the own vehicle by 2nd Embodiment acquired. It is a figure explaining the outline | summary of the information processing system by 3rd Embodiment. It is a flowchart which shows the display process of the acceleration information of the other vehicle by 3rd Embodiment. The figure explaining the case where the acceleration / deceleration information of the other vehicle of the periphery by 3rd Embodiment is displayed is shown. It is a figure which shows the list of the acceleration / deceleration information of the surrounding vehicle which the own vehicle by 3rd Embodiment acquired. It is a figure explaining the outline | summary of the information processing system by 4th Embodiment. It is a flowchart which shows the display process of the recognition information of the other vehicle by 4th Embodiment. It is a figure explaining the case where the recognition information of the target vehicle by 4th Embodiment is displayed. It is a figure explaining the case where the recognition information of the object vehicle by 4th Embodiment is displayed on a Top View screen. It is a figure explaining the case where the driving | running | working prediction result of the user vehicle by 5th Embodiment is notified. It is a figure explaining the warning notification based on the information acquired from the other surrounding vehicle by 5th Embodiment. It is a figure explaining the warning notification based on the information acquired from the other surrounding vehicle by 5th Embodiment. It is a figure explaining the whole information processing system composition by a 6th embodiment. It is a figure explaining the case where the important driving | running | working condition of the close relative by 6th Embodiment is notified. It is a figure explaining the case where the driving condition of each user by a 6th embodiment is automatically contributed to SNS. It is a figure explaining the case where the driving condition of each user by a 6th embodiment is automatically contributed to SNS. It is a figure explaining the case where the content of driving by a 6th embodiment is reflected in a game. It is a block diagram which shows an example of a schematic structure of a vehicle system. It is a block diagram which shows an example of the hardware constitutions of information processing apparatus.
1. 1. Overview of information processing system according to an embodiment of the present disclosure Configuration 2-1. Basic configuration 2-2. Detailed configuration Each embodiment 3-1. First embodiment 3-2. Second embodiment 3-3. Third embodiment 3-4. Fourth embodiment 3-5. Fifth embodiment 3-6. 6. Sixth embodiment Supplement 5. Example of hardware configuration 5-1. Configuration example of vehicle control system 5-2. Configuration example of information processing apparatus 5-3. Others 6. Summary
<< 1. Overview of Information Processing System According to One Embodiment of Present Disclosure >>
An information processing system according to an embodiment of the present disclosure supports, for example, improvement of driving manners, prevention of accidents, comfortable driving, and the like by effectively using information related to user evaluation on a target vehicle. FIG. 1 is a diagram illustrating an overview of an information processing system according to an embodiment of the present disclosure. In the illustrated example, the vehicle 10 </ b> A, the vehicle 10 </ b> B, and the vehicle 10 </ b> C have an inter-vehicle communication function capable of transmitting and receiving signals to and from other vehicles existing in the vicinity.
Here, for example, when the vehicle 10A gives way when the vehicle 10A joins the main line, the vehicle 10A is thankful to the extent that the vehicle 10A does not overload the vehicle 10B (that is, does not hinder travel). Although it is a manner, it is usually done by raising the hand, lowering the head lightly, blinking the hazard lamp once or twice, and the like. Such thanks are ad hoc, but in order to maintain good driving, such thanks may be collected as an evaluation for the driver (or vehicle). For example, the driver of the vehicle 10A who gave the road explicitly evaluates the vehicle 10B by pressing the “Thanks” button provided on the steering wheel or the like or saying “Thank you for giving it!”. I do. The vehicle 10A acquires user evaluation based on pressing of the “Thanks” button or the collected user voice, and transmits the user evaluation to the vehicle 10B recognized as the target vehicle by inter-vehicle communication. The vehicle 10B stores the received evaluation information or presents it with a display device (AR (augmented reality) function of the display or the windshield) visible to the driver, thereby realizing driver communication. For example, messages such as “Thanks” or “Thank you for giving me!” Are displayed on the display device.
As described above, the evaluations from other users of the vehicle 10B that are transmitted from the surrounding vehicles by the inter-vehicle communication are transmitted from the vehicle 10B to the third-party vehicle 10C. The vehicle 10C receives the evaluation information of the vehicle 10B traveling nearby by inter-vehicle communication and presents it on a display device in the vehicle. Therefore, the driver of the vehicle 10C grasps whether the driving manners of the vehicle 10B are good or bad by evaluation information of the vehicle 10B (for example, a numerical value indicating the number of times the vehicle 10B has been “Thanks”, a latest comment, etc.). Can do.
As described above, the evaluation information of each vehicle is also transmitted to the surrounding vehicles, so that, for example, the driver of the vehicle 10C has less number of “Thanks” of the vehicle 10B running in front, and the latest comment is “sudden. If it is “interrupted” or “dangerous meander driving!”, It can be recognized that the vehicle 10B is a dangerous vehicle with bad driving manners. As a result, the driver of the vehicle 10C can prevent accidents and perform comfortable driving by avoiding running behind the vehicle 10B or paying particular attention to the movement of the vehicle 10B.
Also, instead of making thankfulness and criticism of the vehicle temporarily, it is linked to the vehicle as evaluation information and accumulated, and it is also disclosed to surrounding vehicles, so it is easier to see the driving evaluation of yourself The motivation to maintain good driving is sufficiently maintained.
The information on other vehicles that can be obtained from other vehicles by inter-vehicle communication is not limited to the above-described evaluation information, and various information useful for preventing accidents, driving comfortably, improving driving manners, etc. is obtained. Can do.
Moreover, the information of other vehicles is not limited to the example communicated by vehicle-to-vehicle communication, and may be acquired via the management server 4 (see FIG. 28). Each vehicle is communicatively connected to a roadside wireless device 3 (see FIG. 28) installed on the road by road-to-vehicle communication, and transmits / receives data to / from the management server 4 via the roadside wireless device 3. Information of each vehicle is associated with identification information (for example, vehicle number) unique to the vehicle and managed by the management server 4 together with the current position information.
In FIG. 1, the automatic vehicles are illustrated as the vehicle 10 </ b> A, the vehicle 10 </ b> B, and the vehicle 10 </ b> C. However, the present embodiment is not limited to this, and the vehicle 10 may be a motorcycle or a light vehicle. Good.
<< 2. Configuration >>
Next, the configuration of the information processing apparatus 100 that realizes the above-described information processing system will be described with reference to FIGS. 2 and 3. The information processing apparatus 100 can be mounted on a moving body such as the vehicles 10A, 10B, 10C, for example. Alternatively, the information processing apparatus 100 can be mounted on a smartphone, a tablet terminal, a mobile phone terminal, a PC (personal computer), or the like brought into the vehicle 10.
<2-1. Basic configuration>
FIG. 2 is a diagram illustrating an example of a basic configuration of the information processing apparatus 100 according to the present embodiment. As illustrated in FIG. 2, the information processing apparatus 100 includes a control unit 110, a communication unit 120, an input unit 130, an output unit 140, and a storage unit 150.
The control unit 110 functions as an arithmetic processing unit and a control unit, and controls overall operations in the information processing apparatus 100 according to various programs. The control unit 110 is realized by an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor, for example.
The communication unit 120 is a communication module for transmitting and receiving data to and from other devices by wire / wireless. For example, the communication unit 120 communicates with another information processing apparatus 100 or the roadside apparatus 3. In addition, the communication unit 120 is a communication module that performs inter-vehicle communication with another information processing apparatus 100 mounted on another vehicle that travels in the vicinity, and a communication module that performs communication with the roadside apparatus 3 installed in the vicinity. And at least one of a communication module for communicating with a mobile phone communication network and a communication module for communicating with the Internet network.
The input unit 130 receives information input from the outside to the information processing apparatus 100. For example, the input unit 130 can be realized by a touch panel, a switch, a button, a microphone, and various sensors.
The output unit 140 outputs information by video, image, sound, vibration, or the like. For example, the output unit 140 is realized by a display device (AR of a display or a windshield) installed so as to be recognized by a driver of the vehicle, a speaker, or the like.
The storage unit 150 is realized by a ROM (Read Only Memory) that stores programs used in the processing of the control unit 110, calculation parameters, and the like, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
<2-2. Detailed configuration>
FIG. 3 is a diagram illustrating an example of a detailed configuration of the information processing apparatus 100 according to the present embodiment. As shown in FIG. 3, the information processing apparatus 100 includes an in-vehicle device 1301, a sensor 1302, an operation input unit 1303, a microphone 1304, a vehicle-to-vehicle communication unit 1201, a road-to-vehicle communication unit 1202, a network I / F (interface) unit 1203, A recognition unit 1101, a user evaluation acquisition unit 1102, a notification information generation unit 1103, a notification control unit 1104, an estimation unit 1105, a display unit 1401, and a speaker 1402 are included.
The in-vehicle device 1301, the sensor 1302, the operation input unit 1303, and the microphone 1304 are examples of the input unit 130. The in-vehicle device 1301 is a device or system provided in a vehicle, and for example, a speedometer, a fuel consumption meter, a navigation device, a driving assist system such as a cruise controller or an automatic brake, safety equipment, and an automatic driving system are assumed. . Examples of information obtained from the in-vehicle device 1301 by the recognition unit 1101 and the estimation unit 1105 include the following information.
The sensor 1302 detects various information in and around the vehicle. For example, the sensor 1302 is assumed to be a camera (image sensor), a depth sensor, a line-of-sight sensor, a touch sensor, a vital sensor, an emotion sensor, and the like. Examples of information obtained from the sensor 1302 by the recognition unit 1101 and the estimation unit 1105 include the following information.
The operation input unit 1303 detects operation input information by the user. For example, the operation input unit 1303 is realized by a touch panel, a switch, a button, or the like. The operation input unit 1303 includes a “Thanks” button (an example of an evaluation button) provided around the steering wheel, lever switch, or steering. Information obtained by the user evaluation acquisition unit 1102 from the operation input unit 1303 includes, for example, information on pressing a “Thanks” button (an example of information related to evaluation of other vehicles by the user).
The microphone 1304 collects the speech from the user. Information obtained by the user evaluation acquisition unit 1102 from the microphone 1304 includes, for example, an evaluation comment on the other vehicle by the user such as “Thank you for handing over”. The information obtained by the estimation unit 1105 from the microphone 1304 includes, for example, information requests to other vehicles by the user, such as “I wonder if that car is flirting but is dangerous” or “Where did everyone come from?”.
The in-vehicle device 1301, the sensor 1302, the operation input unit 1303, or the microphone 1304 described above may be provided separately from the information processing apparatus 100 in the vehicle.
A vehicle-to-vehicle communication unit 1201, a road-to-vehicle communication unit 1202, and a network I / F (interface) unit 1203 are examples of the communication unit 120. The vehicle-to-vehicle communication unit 1201 and the road-to-vehicle communication unit 1202 perform data communication between a vehicle and a vehicle, and a vehicle and a roadside wireless device by short-range wireless communication such as Wi-Fi (registered trademark) and BlueTooth (registered trademark), for example. . The network I / F unit 1203 performs data communication between the vehicle and the network through a mobile network such as 4G (LTE; Long Term Evolution) or 3G. The inter-vehicle communication unit 1201 may realize data communication with another vehicle by visible light communication using a high-speed blinking pattern such as a headlight, a vehicle width lamp, a winker, and a brake lamp.
The recognition unit 1101, the user evaluation acquisition unit 1102, the notification information generation unit 1103, the notification control unit 1104, and the estimation unit 1105 are functional examples of the control unit 110. The recognition unit 1101 recognizes the target vehicle that the user is paying attention to and the target vehicle when the user performs evaluation. The recognition unit 1101 may automatically recognize the target vehicle based on information (that is, user environment information) obtained from the in-vehicle device 1301, the sensor 1302, and the communication unit 120. The user environment information is, for example, the traveling state of the user vehicle, the user's line-of-sight information, the user's concentration, the user's utterance content, the user's surrounding information, and the positional relationship between the user vehicle and surrounding vehicles. The recognition unit 1101 can automatically recognize the target vehicle by, for example, comprehensively interpreting various types of obtained information (user environment information) using machine learning. The recognition unit 1101 may recognize the target vehicle in accordance with a user instruction input from the operation input unit 1303, the microphone 1304, or the like.
Here, an example of a method for recognizing the target vehicle will be described with reference to FIG. FIG. 4 is a diagram for explaining an example of a method for recognizing a target vehicle according to the present embodiment. As shown on the left side of FIG. 4, for example, when the vehicle 10A joins the main line and the vehicle 10B running on the main line gives up the road immediately before joining, the vehicle 10A is based on the positional relationship between the vehicle 10A and the vehicle 10B. The information processing apparatus 100 mounted on the vehicle recognizes the vehicle 10B as a target vehicle that the user pays attention to. The positional relationship between the vehicle 10A and the vehicle 10B is, for example, an image obtained from a camera which is an example of the sensor 1302, distance information obtained from a stereo camera, distance information obtained from an infrared sensor, and a vehicle-to-vehicle communication unit 1201. It is acquired based on the signal obtained from 10B. Further, as illustrated on the right side of FIG. 4, the vehicle 10 </ b> C being watched by the user may be recognized as the target vehicle based on the driver's line-of-sight information. The line-of-sight information is obtained from a line-of-sight sensor which is an example of the sensor 1302. The vehicle 10 </ b> C existing in the line-of-sight direction indicated by the line-of-sight information is recognized from an image captured by an outwardly provided camera, which is an example of the sensor 1302. When the driver is looking at the side mirror or the rearview mirror, the recognition unit 1101 recognizes the vehicle reflected in the mirror based on the captured image obtained by capturing the side mirror or the rearview mirror according to the driver's line of sight. To do. In addition to the line-of-sight information, the recognition unit 1101 further uses the driver's concentration degree obtained from a vital sensor, which is an example of the sensor 1302, to more accurately determine the target vehicle to which the driver is paying attention. Is possible.
The recognition unit 1101 can also perform individual recognition of the recognized target vehicle. The individual identification information (ID) of the target vehicle may be extracted from a signal received from the target vehicle via the vehicle-to-vehicle communication unit 1201, or based on the vehicle number, vehicle type, and color information acquired by image recognition. The above database may be queried to obtain individual identification information. Further, a vehicle that is not in the database may be automatically newly registered on the database side.
The user evaluation acquisition unit 1102 acquires information regarding the evaluation of the user (here, the driver) for the target vehicle. Specifically, for example, the user evaluation acquisition unit 1102 acquires, as user evaluation information, from the operation input unit 1303, information that a “Thanks” button that is an example of the operation input unit 1303 is pressed. In addition, the user evaluation acquisition unit 1102 analyzes the user's uttered voice collected by the microphone 1304, and acquires a user comment converted into text as user evaluation information.
The notification information generation unit 1103 is based on the user evaluation acquired by the user evaluation acquisition unit 1102 and the target vehicle recognized by the recognition unit 1101 (the vehicle that the driver pays attention to and is the evaluation target vehicle here). The information for notifying the user evaluation for the target vehicle is generated. For example, the notification information generation unit 1103 generates an evaluation display screen that displays user evaluation for the target vehicle. The notification information generation unit 1103 can also generate a reason for user evaluation based on at least one of the recognized information on the target vehicle and the user's environment information. The reason for the generated user evaluation can be associated with the user evaluation and stored in the storage unit 150 or transmitted from the communication unit 120 to the target vehicle or a third-party vehicle.
The notification control unit 1104 controls to notify the notification information generated by the notification information generation unit 1103 to a predetermined notification destination. For example, the notification control unit 1104 controls the generated notification information to be transmitted to the target vehicle by the inter-vehicle communication unit 1201. In addition, the notification control unit 1104 may perform control so as to notify the driver of the evaluation information for the host vehicle received by the inter-vehicle communication unit 1201 from the display unit 1401 or the speaker 1402. In addition, the notification control unit 1104 may perform control so as to notify the driver of the evaluation information of the target vehicle received by the inter-vehicle communication unit 1201 from the display unit 1401 or the speaker 1402. The transmission / reception of the evaluation information is not limited to vehicle-to-vehicle communication, and may be performed via the road-to-vehicle communication unit 1202 or the network I / F unit 1203. The evaluation information may include unique identification information of the target vehicle, an evaluation reason, and the like.
The estimation unit 1105 estimates the type of information that the driver currently desires and what information (for example, type) the information to be notified to the driver is. For example, the estimation unit 1105 is obtained from the driver's line-of-sight information obtained from the line-of-sight sensor, the driver's concentration obtained from the vital sensor, the driving situation obtained from the in-vehicle device 1301, the driving content, and the microphone 1304 (voice sensor). Based on at least one of the contents of the driver's utterance, it is comprehensively interpreted using machine learning to estimate what information is currently appropriate for the driver. For example, the estimation unit 1105 estimates that the user wants to know only the speed of other vehicles and dangerous vehicles while cruising on a highway, and the other vehicle's moving direction (straight, Estimate that you want to know acceleration / deceleration information and blind spot information, and that you want to know the evaluation of surrounding vehicles while the vehicle is stopped. Further, the estimation unit 1105 estimates that the driver wants to know the degree of danger of the target vehicle when the driver utters “That car is flirting ...”, and utters “Where are you all coming from?” If it does, it is estimated that the driver's address (prefecture information) of the surrounding vehicle would be desired. The estimation unit 1105 may adjust the content and amount of information to be presented to the driver, the presentation method, and the like according to the driver's concentration degree obtained by the vital sensor. For example, when the degree of concentration of the driver is low, the estimation unit 1105 adjusts to present more critical information and realizes alerting the driver. When the estimation unit 1105 estimates information currently appropriate for the driver, the estimation unit 1105 makes a request for information estimated from the communication unit 120 to a predetermined request destination. For example, the estimation unit 1105 may include the speed of surrounding vehicles, dangerous vehicle information (risk level of surrounding vehicles), the moving direction of other vehicles (straight, right turn, left turn), acceleration / deceleration information, blind spot information, or evaluation information. Are estimated to be currently appropriate information, the corresponding information is acquired from the surrounding vehicles by the inter-vehicle communication unit 1201. Dangerous vehicle information (risk of surrounding vehicles) may be extracted from the evaluation information (that is, a vehicle with a low evaluation and a bad driving manner evaluation is a dangerous vehicle (high risk) )). These pieces of information obtained by the communication unit 120 are presented to the driver from the display unit 1401 and the speaker 1402 by the notification control unit 1104.
Display unit 1401 and speaker 1402 are examples of output unit 140. The display unit 1401 is realized by a display device such as a liquid crystal display (LCD) device or an organic light emitting diode (OLED) display device. The display unit 1401 is an AR display in a transmissive / semi-transmissive head-up display or a windshield provided at a position in the driver's field of view that can be read without changing the line of sight from the front. May be performed. The display unit 1401 may be realized by an HMD (head mounted display) worn by the driver, and AR display may be performed on the HMD. In the AR display, information is displayed so as to correspond to an actual vehicle.
The detailed configuration of the information processing apparatus 100 according to an embodiment of the present disclosure has been described above. Next, the information processing system will be specifically described using a plurality of embodiments.
<< 3. Each embodiment >>
<3-1. First Embodiment>
First, the information processing system according to the first embodiment will be described with reference to FIGS. In the first embodiment, an evaluation process for other vehicles and utilization of evaluation information accumulated in each vehicle will be described.
FIG. 5 is a flowchart showing an evaluation input process to another vehicle according to the first embodiment. As shown in FIG. 5, first, the user evaluation acquisition unit 1102 of the information processing apparatus 100 determines that the user (here, the driver) has pressed the “Thanks” button detected by the operation input unit 1303. Obtained as information (step S103).
Also, the user evaluation acquisition unit 1102 recognizes (converts to text) the driver's utterance collected by the microphone 1304 and acquires it as user evaluation information (step S106).
Next, the recognition unit 1101 of the information processing apparatus 100 acquires information used to recognize the evaluation target vehicle from the sensor 1302 and the in-vehicle device 1301 (step S109). For example, the recognition unit 1101 acquires the driver's line-of-sight information from the line-of-sight sensor, the captured image of the surrounding vehicle, the positional relationship information with the surrounding vehicle, the driving situation of the vehicle, and the like from the camera.
Next, the recognizing unit 1101 recognizes a vehicle that is focused on by the driver (that is, a vehicle that is subject to user evaluation) based on the acquired information (step S112). For example, when the “Thanks” button is pressed when the user vehicle joins the main line or the driver speaks “thank you”, the recognition unit 1101 joins the main line based on the positional relationship information and the captured image. It is recognized that the other vehicle running behind (the other vehicle that gave up the road at the time of joining) is the vehicle to be evaluated. Further, when the user vehicle suddenly brakes and utters “Dangerous!”, The recognizing unit 1101 recognizes that another vehicle that has appeared (interrupted) in front of the user vehicle based on the line-of-sight information and the captured image. Recognize that the vehicle is an evaluation target. The recognition unit 1101 may acquire individual identification information of the target vehicle. The individual identification information of the target vehicle may be acquired from the management server 4 on the network based on information such as the number, vehicle type, and color of the target vehicle obtained by analyzing the captured image. You may acquire by communication.
Next, the notification information generation unit 1103 provides information for notifying the user evaluation for the target vehicle based on the user evaluation acquired by the user evaluation acquisition unit 1102 and the information on the target vehicle recognized by the recognition unit 1101. Generate (step S115). Such information may include individual identification information of the target vehicle.
Next, the notification control unit 1104 transmits the generated notification information to the recognized vehicle via the inter-vehicle communication unit 1201 (step S118). Further, the notification control unit 1104 may transmit the generated notification information to the management server 4 on the network via the network I / F unit 1203. Further, the notification control unit 1104 may notify the user (the driver of the user vehicle) that the user evaluation for the target vehicle has been performed from the display unit 1401 or the speaker 1402. Such notification information may be notified in real time when evaluation is performed.
The notification information transmitted to the target vehicle is notified to the driver of the target vehicle. FIG. 6 is a diagram illustrating a display example when a user evaluation is notified in the target vehicle. Here, for example, as shown in FIG. 1, when the vehicle 10A joins the main line, the driver of the vehicle 10A evaluates the vehicle 10B that has given way, and notification information for notifying the evaluation is the vehicle 10A. A case will be described in which the vehicle is transmitted to the vehicle 10B and AR is displayed on the windshield. As shown in FIG. 6, the windshield 1401B of the vehicle 10B has a frame image 30 displayed so as to surround the vehicle 10A so as to specify the vehicle that has been evaluated, and the vehicle that the “Thanks” button has been pressed. An evaluation information image 31 that displays evaluation information such as a comment display from 10A is displayed as an AR. Although not shown in FIG. 6, the user evaluation reason (evaluation reason) may be displayed together with the user evaluation.
In the above, the evaluation input process to the other vehicle by this embodiment was demonstrated. Note that the evaluation input process according to the present embodiment is not limited to the flowchart shown in FIG. 5. For example, the information processing apparatus 100 may perform control so as to notify the user of the evaluation. More specifically, for example, when the recognition unit 1101 determines that the information processing apparatus 100 has “given the road”, the information processing apparatus 100 performs “Thanks” to the vehicle that has given the road to the user. The notification information generation unit 1103 generates notification information such as “??”. Then, the information processing apparatus 100 notifies the user of the generated notification information from the display unit 1401 or the speaker 1402 by the notification control unit 1104 and proposes positive evaluation. In addition, when the recognition unit 1101 determines that “a dangerous interruption has occurred”, the information processing apparatus 100 generates notification information for making a negative evaluation or suggesting it, and notifies the user. Next, the case where the evaluation information of the vehicle traveling around is displayed will be described with reference to FIGS.
FIG. 7 is a flowchart showing a display process of evaluation information of other vehicles. As illustrated in FIG. 7, first, the estimation unit 1105 of the information processing apparatus 100 acquires information for estimating information required by the user (here, the driver) from the sensor 1302 and the in-vehicle device 1301 (step). S123). For example, the estimation unit 1105 acquires line-of-sight information, a captured image, a current position, a driving situation, and the like from the in-vehicle device 1301 from the sensor 1302.
Next, the estimation unit 1105 estimates information that the driver currently needs (or information that is currently appropriate for the driver) based on the acquired information (step S126). In this embodiment, for example, when the user vehicle goes straight in the city and the driver is watching the surrounding vehicle, the driver wants to know the evaluation information of the surrounding vehicle or the surrounding vehicle evaluation information. Is currently appropriate.
Next, the vehicle-to-vehicle communication unit 1201 acquires information related to evaluation from surrounding vehicles according to the estimation result of the estimation unit 1105 (step S129). Specifically, evaluation information from other users accumulated in each vehicle is acquired.
Then, the notification control unit 1104 controls the display unit 1401 to display the evaluation information acquired from the surrounding vehicles by the inter-vehicle communication unit 1201 according to the estimation result of the estimation unit 1105 (step S132). Here, FIG. 8 shows a diagram for explaining a case where evaluation information of other vehicles in the vicinity is displayed. In the example shown in FIG. 8, the information processing apparatus 100 mounted on the vehicle 10D acquires evaluation information of each vehicle from the vehicles 10B and 10D traveling around the vehicle 10D and notifies the driver of the vehicle 10D. Assumed. As shown in FIG. 8, on the windshield 1401D of the vehicle 10D, the vehicle 10B to identify each vehicle, frame images 32 and 34 displayed so as to surround the vehicle 10C, and the latest input to each vehicle Evaluation comment images 33 and 35 for displaying the evaluation comments are displayed as AR. Further, the frame images 32 and 34 include information indicating the number of times the “Thanks” button performed on each vehicle is pressed. As a result, the driver of the vehicle 10D can easily know the evaluation of the vehicle running in the vicinity, and if the “Thanks” button is pressed many times or the evaluation comment is good, the manner of It can be recognized as a good vehicle, and it is possible to drive comfortably with peace of mind.
The display method of the evaluation information according to the present embodiment is not limited to the AR display on the windshield as shown in FIGS. 6 and 8, for example, a display device (smart phone etc. fixed around the steering wheel). For example, a Bird View screen or a Top View screen generated by computer graphics (CG) may be displayed. By displaying in Bird View or Top View, it becomes possible to easily grasp the positional relationship between the user vehicle and surrounding vehicles. Here, FIG. 9 is a diagram illustrating a case where evaluation information of other vehicles traveling around is displayed on the Top View screen. As shown in FIG. 9, the display device 1401d is installed around the steering wheel so that the driver can visually recognize the driver's line of sight from the front without much diversion. The display device 1401d displays a user vehicle (vehicle 10D) and surrounding vehicles 10B and 10C on a map. The image displayed on the display device 1401d can be generated by the notification control unit 1104, for example. The positional relationship of each vehicle is grasped based on a signal received from each vehicle or an image captured by a camera. The evaluation information display images 36 and 37 that display the number of “Thanks” and the evaluation comments are displayed, for example, partly superimposed on the vehicles 10B and 10C so as to correspond to the vehicles 10B and 10C. Thereby, the user of vehicle 10D can grasp | ascertain the evaluation of a surrounding vehicle easily.
The displayed evaluation is not limited to positive information, and negative information is naturally assumed. FIG. 10 is a diagram illustrating a case where the evaluation information of the target vehicle is negative. As shown in FIG. 10, for example, a frame image 38 including the number of “Thanks” and an evaluation comment image 39 are displayed on the windshield 1401D of the vehicle 10D so as to correspond to the vehicle 10B, and “Thanks” so as to correspond to the vehicle 10C. A frame image 40 including the number of images and an evaluation comment image 41 are displayed. As a result, the driver of the vehicle 10D can easily know the evaluation of the vehicle running in the vicinity, and if the “Thanks” button is pressed less frequently or the evaluation comment is bad, the manner of It can be recognized that the vehicle is a bad vehicle, and an accident can be prevented in advance by driving or paying special attention to the movement of the target vehicle.
<3-2. Second Embodiment>
Next, an information processing system according to the second embodiment will be described with reference to FIGS. In the second embodiment, utilization of speed information of other vehicles will be described.
FIG. 11 is a flowchart showing a display process of speed information of another vehicle according to the second embodiment. As illustrated in FIG. 11, first, the estimation unit 1105 of the information processing apparatus 100 acquires information for estimating information required by the user (here, the driver) from the sensor 1302 and the in-vehicle device 1301 (step). S203). For example, the estimation unit 1105 acquires line-of-sight information, a captured image, a current position, a driving situation, and the like from the in-vehicle device 1301 from the sensor 1302.
Next, the estimation unit 1105 estimates information that the driver currently needs (or information that is currently appropriate for the driver) based on the acquired information (step S206). In the present embodiment, for example, when the user vehicle is traveling on an expressway, the driver wants to know the speed information of the surrounding vehicle at present, or estimates that the speed information of the surrounding vehicle is currently appropriate.
Next, the inter-vehicle communication unit 1201 acquires speed information from the surrounding vehicles according to the estimation result of the estimation unit 1105 (step S209). Specifically, speed information detected from the in-vehicle device of each vehicle is acquired.
Then, the notification control unit 1104 controls the display unit 1401 to display speed information acquired from the surrounding vehicles by the inter-vehicle communication unit 1201 according to the estimation result of the estimation unit 1105 (step S212). Here, FIG. 12 is a diagram illustrating a case where speed information of other vehicles in the vicinity is displayed. In the example shown in FIG. 12, the information processing apparatus 100 mounted on the vehicle 10D acquires speed information of each vehicle from the vehicles 10B and 10D traveling around the vehicle 10D and notifies the driver of the vehicle 10D. Assumed. As shown in FIG. 12, speed display images 45 and 46 for displaying the speed of each vehicle are AR-displayed on the windshield 1401D of the vehicle 10D. As a result, the driver of the vehicle 10D can easily know the speed of the vehicle running in the vicinity, avoiding overspeeding by a vehicle that is overspeeding, or overtaking a particularly slow vehicle. Judgment can be made accurately.
The speed information display method according to the present embodiment is not limited to the AR display on the windshield. For example, in a display device installed around the steering wheel (which may be a smartphone fixed), for example, CG ( The Bird View screen and Top View screen generated by computer graphics may be displayed.
FIG. 13 is a diagram illustrating a case where speed information of other vehicles traveling around is displayed on the Top View screen. As shown in FIG. 13, the display device 1401d installed around the steering wheel displays the user vehicle (vehicle 10D) and the surrounding vehicles 10B and 10C on a map. The speed information display images 47 and 48 indicating the speed information are displayed so as to partially overlap the vehicles 10B and 10C, for example, so as to correspond to the vehicles 10B and 10C. Thereby, the user of vehicle 10D can grasp | ascertain the speed of the surrounding vehicle easily.
FIG. 14 is a diagram illustrating a case where speed information of other vehicles traveling around is displayed on the Bird View screen. In the illustrated example, a CG image assuming that the user vehicle (vehicle 10D) and the surrounding vehicles 10B and 10C are viewed from the viewpoint of the rear sky is displayed on the screen of the display device 1401d. The positional relationship of each vehicle is grasped based on a signal received from each vehicle or an image captured by a camera. And the speed information display images 49 and 50 which show speed information are displayed, for example, partly superimposed on the vehicles 10B and 10C so as to correspond to the vehicles 10B and 10C. Thereby, the user of vehicle 10D can grasp | ascertain the speed of the surrounding vehicle easily.
In the second embodiment described above, the case where the speed of the target vehicle is received from the target vehicle by the inter-vehicle communication unit 1201 has been described, but the present embodiment is not limited to this.
FIG. 15 is a diagram illustrating an information acquisition route from another vehicle. As shown in FIG. 15, for example, the vehicle 10D can acquire the speed information of the vehicle 10B by inter-vehicle communication, but can acquire the speed information of the vehicle 10A that travels away from the vehicle via a network. When the vehicle 10C does not support communication, the recognition unit 1101 of the information processing apparatus 100 mounted on the vehicle 10D causes the analysis result of the captured image obtained by capturing the vehicle 10C, the distance information obtained from the stereo camera, or the infrared sensor. The relative speed of the vehicle 10C may be calculated based on the distance information obtained from the vehicle and estimated based on the speed of the host vehicle.
Moreover, the estimation of the speed of the vehicle 10C is also performed in the other vehicle, and the vehicle 10D can also acquire the speed information of the vehicle 10C estimated by the other vehicle via inter-vehicle communication or network communication. Thus, when the speed of the target vehicle is obtained by various methods, the information processing apparatus 100 of the vehicle 10D may adopt and display information having the highest reliability. Hereinafter, a specific description will be given with reference to FIG.
FIG. 16 is a diagram illustrating a list of speed information of surrounding vehicles acquired by the vehicle 10D (own vehicle). In the illustrated example, the speed information of the vehicles 10A, 10B, and 10C estimated by the vehicle 10D (own vehicle), the vehicle 10A, and the vehicle 10B is shown. The vehicle 10D can acquire the speed information of the vehicles 10A, 10B, and 10C estimated by the vehicle 10A and the vehicle 10B, respectively, via inter-vehicle communication or network communication. The positional relationship between the vehicles 10A to 10C is as shown in FIG. 15, and the vehicle 10C is a vehicle that does not support communication.
As shown in FIG. 16, each speed information includes a speed error (plus or minus km / h) corresponding to the distance from the estimation subject to the estimation target. For example, the speed information of the vehicles 10 </ b> A to 10 </ b> C estimated by the vehicle 10 </ b> D based on the captured image or the like has a larger speed error as the speed information of the target vehicle farther from the vehicle 10 </ b> D as illustrated in FIG. 15. The same applies to the case where the vehicles 10A and 10B are estimation subjects. If the estimation subject and the estimation target are the same, the speed error is 0 km / h.
The notification control unit 1104 of the information processing apparatus 100 mounted on the vehicle 10D employs the speed information with the smallest speed error among the speed information of each other vehicle, and controls the display unit 1401 to display the information. Therefore, in the example shown in FIG. 16, the speed “95 km / h (error 0 km / h)” estimated by the vehicle 10A is adopted as the speed information of the vehicle 10A, and the speed “estimated by the vehicle 10B” is used as the speed information of the vehicle 10B. 86 km / h (error 0 km / h) ”is adopted, and the speed“ 94 km / h (error 1 km / h) ”estimated by the vehicle 10B closest to the vehicle 10C is adopted as the speed information of the vehicle 10C.
<3-3. Third Embodiment>
Next, an information processing system according to the third embodiment will be described with reference to FIGS. In the third embodiment, utilization of information related to acceleration / deceleration of other vehicles will be described.
FIG. 17 is a diagram illustrating an overview of an information processing system according to the third embodiment. As shown in FIG. 17, the driver of the vehicle 10A waiting for a right turn at the intersection knows that the oncoming vehicle 10B is decelerating in response to the yellow signal, but is a blind spot of the vehicle 10B. The trend of 10E (motorcycle here) cannot be grasped visually. In this case, if the vehicle 10A tries to turn right at the intersection, there is a high possibility that the vehicle 10A will come into contact with the vehicle 10E that has traveled straight and cause an accident. Therefore, in the present embodiment, for example, when the vehicle is about to turn a road, safer driving can be supported by acquiring acceleration / deceleration of surrounding vehicles and notifying the driver. In the example shown in FIG. 17, by grasping information that the vehicle 10E existing in the blind spot of the vehicle 10B is accelerating, it is possible to safely turn right after waiting for the vehicle 10E to go straight.
FIG. 18 is a flowchart showing a display process of acceleration information of another vehicle according to the third embodiment. As shown in FIG. 18, first, the estimation unit 1105 of the information processing apparatus 100 acquires information for estimating information required by the user (here, the driver) from the sensor 1302 and the vehicle-mounted device 1301 (step S303). For example, the estimation unit 1105 acquires line-of-sight information, a captured image, a current position, a driving situation, and the like from the in-vehicle device 1301 from the sensor 1302.
Next, the estimation unit 1105 estimates information that the driver currently needs (or information that is currently appropriate for the driver) based on the acquired information (step S306). In the present embodiment, for example, when the user vehicle is waiting for a right turn / left turn at an intersection, the driver wants to know acceleration / deceleration information of the surrounding vehicle or the acceleration / deceleration information of the surrounding vehicle is currently appropriate. Estimated.
Next, the inter-vehicle communication unit 1201 acquires acceleration / deceleration information from surrounding vehicles according to the estimation result of the estimation unit 1105 (step S309). Specifically, acceleration / deceleration information detected from the in-vehicle device of each vehicle is acquired. As shown in FIG. 17, even when the vehicle 10A and the vehicle 10E are separated from each other and the inter-vehicle communication cannot be performed, the vehicle 10A receives the vehicle 10E information from the vehicle 10B as the surrounding vehicle information received by the vehicle 10E. Information may be acquired. As a result, the vehicle 10A can also acquire information on a bicycle or motorcycle in front of several tens of meters with low reliability.
Then, the notification control unit 1104 controls the display unit 1401 to display acceleration / deceleration information acquired from the surrounding vehicle by the inter-vehicle communication unit 1201 according to the estimation result of the estimation unit 1105 (step S312). Here, FIG. 19 shows a diagram for explaining a case where acceleration / deceleration information of other vehicles in the vicinity is displayed. In the example illustrated in FIG. 19, it is assumed that the information processing apparatus 100 mounted on the vehicle 10D acquires acceleration information of vehicles around the intersection and notifies the driver of the vehicle 10D. As illustrated in FIG. 19, speed display images 51 and 52 that display acceleration / deceleration of each vehicle are AR-displayed on the windshield 1401D of the vehicle 10D. Although the vehicle 10E is in the blind spot of the vehicle 10B and cannot be visually recognized by the driver, as shown in FIG. 19, an emphasis display 53 for clearly indicating the hidden vehicle 10E is displayed. Thereby, the driver of the vehicle 10D can easily grasp that the vehicle 10B of the oncoming vehicle is decelerated, but that the vehicle 10E exists in the blind spot, and further that the vehicle 10E is accelerating, Accidents can be prevented in advance.
In the third embodiment described above, acceleration / deceleration information of the vehicle 10B is received from the vehicle 10B. However, the present embodiment is not limited to this, and the recognition unit 1101 of the information processing apparatus 100 is captured by a camera. It is also possible to estimate the acceleration / deceleration of the target vehicle based on analysis of the captured image, distance information obtained from the stereo camera, and distance information obtained from the infrared sensor.
Alternatively, the notification control unit 1104 may perform control so as to employ the highly reliable information of the acquired acceleration / deceleration information of surrounding vehicles and notify the driver. Hereinafter, this will be specifically described with reference to FIG.
FIG. 20 is a diagram showing a list of acceleration / deceleration information of surrounding vehicles acquired by the vehicle 10A (own vehicle). In the illustrated example, acceleration / deceleration information of the vehicles 10B and 10E estimated by the vehicle 10A (own vehicle) and the vehicle 10B is shown. The vehicle 10A can acquire acceleration / deceleration information of the vehicle 10A and the vehicle 10E estimated by the vehicle 10B via inter-vehicle communication or network communication. The positional relationship between the vehicles 10A, 10B, and 10E is as shown in FIG. 17, and the vehicle 10E is hidden in the blind spot of the vehicle 10B. Here, the vehicle 10E is a vehicle that does not support communication.
As shown in FIG. 20, each speed information includes a reliability (percentage) corresponding to the positional relationship between the estimation subject and the estimation target. For example, the recognition unit 1101 of the information processing apparatus 100 mounted on the vehicle 10A can estimate acceleration / deceleration of the vehicle 10B based on a captured image by a camera, distance information by a stereo camera, distance information by an infrared sensor, or the like. When the vehicle 10B is slightly separated from the vehicle 10A, for example, the reliability of acceleration is 40% and the reliability of deceleration is 60%. On the other hand, when the estimation subject and the estimation target are the same, the reliability is 100%. Further, since the vehicle 10A to the vehicle 10E cannot be detected by a camera, an infrared sensor, or the like, estimation is impossible. Further, the estimation result of the vehicle 10E mainly composed of the vehicle 10B has a reliability of 100% because the vehicle 10E is close to the vehicle 10B.
The notification control unit 1104 of the information processing apparatus 100 mounted on the vehicle 10 </ b> A employs the one with the highest reliability among the acceleration / deceleration information of each other vehicle, and controls to display on the display unit 1401. Therefore, in the example shown in FIG. 20, the acceleration / deceleration information “deceleration (reliability 100%)” estimated by the vehicle 10B is adopted for the acceleration / deceleration of the vehicle 10B, and the acceleration / deceleration information estimated by the vehicle 10B is used for the acceleration / deceleration information of the vehicle 10E. Deceleration information “Acceleration (100% reliability)” is adopted.
<3-4. Fourth Embodiment>
Next, an information processing system according to the fourth embodiment will be described with reference to FIGS. In the fourth embodiment, utilization of information regarding whether or not another vehicle recognizes the own vehicle (awareness of the other vehicle to the own vehicle) will be described.
FIG. 21 is a diagram illustrating an overview of an information processing system according to the fourth embodiment. As shown in FIG. 21, for example, when the vehicle 10A traveling in the front left lane exits the right turn signal while the vehicle B is traveling, the driver of the vehicle 10B notices the own vehicle in which the vehicle 10A is in the blind spot on the right rear. I'm worried whether or not. If it is found that the vehicle 10A is aware of the host vehicle (the vehicle 10B), the driver of the vehicle 10B is likely to decelerate and wait for the opponent's lane change because there is no sudden lane change. Whether or not the vehicle 10A is aware of the host vehicle (the vehicle 10B) is notified from the vehicle 10A by inter-vehicle communication, for example. As described above, the information on whether or not the target vehicle recognizes the presence of the host vehicle is not limited to the time when the lane of the preceding vehicle is changed. For example, when the preceding vehicle is moving backward or the signal is red or traffic jams. This is also useful when the following vehicle approaches without decelerating during deceleration. Hereinafter, specific operation processing of the present embodiment will be described with reference to FIG.
FIG. 22 is a flowchart showing a process for displaying recognition information of another vehicle according to the fourth embodiment. As illustrated in FIG. 22, first, the estimation unit 1105 of the information processing device 100 acquires information for estimating information required by the user (here, the driver) from the sensor 1302 and the in-vehicle device 1301 (step). S403). For example, the estimation unit 1105 acquires line-of-sight information, a captured image, a current position, a driving situation, and the like from the in-vehicle device 1301 from the sensor 1302.
Next, the estimation unit 1105 estimates information that the driver currently needs (or information that is currently appropriate for the driver) based on the acquired information (step S406). In the present embodiment, for example, the driver currently wants to know information (hereinafter also referred to as recognition information) regarding whether or not the target vehicle recognizes the own vehicle (whether or not it is noticed), or the recognition information is Presume that it is currently appropriate for the driver.
Next, the inter-vehicle communication unit 1201 acquires recognition information from the target vehicle according to the estimation result of the estimation unit 1105 (step S409). Specifically, driver recognition information detected from an in-vehicle device or a line-of-sight sensor of the target vehicle, or vehicle recognition information in the case of automatic driving is acquired.
Next, the notification control unit 1104 controls the inter-vehicle communication unit 1201 to display the recognition information acquired from the surrounding vehicles according to the estimation result of the estimation unit 1105 on the display unit 1401 (step S412). Here, FIG. 23 is a diagram illustrating a case where the recognition information of the target vehicle is displayed. In the illustrated example, the notice display image 55 indicating that the target vehicle recognizes the host vehicle is AR-displayed on the windshield 1401B of the vehicle 10B. The target vehicle is identified by the recognition unit 1101 based on the line-of-sight information of the driver of the vehicle 10B, the captured image of the camera, and the like. On the other hand, a question mark may be displayed when the target vehicle does not recognize the host vehicle or when it is unknown whether or not it is recognized. As a result, the driver of the vehicle 10B can easily grasp whether or not the target vehicle in the front left lane which is about to change the lane by taking out the right turn signal is aware of the own vehicle.
Note that the recognition information display method according to the present embodiment is not limited to the AR display on the windshield. For example, in a display device (which may be a smartphone or the like) installed around the steering wheel, for example, CG ( The Bird View screen and Top View screen generated by computer graphics may be displayed.
FIG. 24 is a diagram illustrating a case where the recognition information of the target vehicle is displayed on the Top View screen. As shown in FIG. 24, the display device 1401b installed around the steering wheel displays the user vehicle (vehicle 10B) and the target vehicle 10A on a map, indicating that the vehicle 10A is aware of the vehicle 10B. The notice display image 56 is displayed so as to correspond to the vehicle 10A. Thereby, the user of the vehicle 10B can easily grasp that the target vehicle is aware of the own vehicle.
Subsequently, returning to FIG. 22, the information processing apparatus 100 requires a risk avoidance action according to the recognition information of the other vehicle when the driving assist system is mounted on the own vehicle and control by the information processing apparatus 100 is possible. It is determined whether or not (step S415). For example, the information processing apparatus 100 determines that an action for avoiding danger is necessary when the target vehicle is not aware of the host vehicle and tries to change lanes or moves backward.
If it is determined that a risk avoidance action is necessary (step S415 / Yes), the information processing apparatus 100 executes a risk avoidance action such as automatically turning on the hazard lamp of the host vehicle (step S418). Alternatively, the information processing apparatus 100 may notify the target vehicle of the presence of the host vehicle through inter-vehicle communication. As a result, the target vehicle can be made aware of the presence of the host vehicle, and danger can be avoided.
<3-5. Fifth Embodiment>
Next, an information processing system according to the fifth embodiment will be described with reference to FIGS. In the fifth embodiment, a travel prediction result and warning notification of a user vehicle based on various information acquired from another vehicle will be described.
FIG. 25 is a diagram for explaining a case of notifying the traveling prediction result of the user vehicle. The information processing apparatus 100 mounted on the user vehicle (here, the vehicle 10A) recognizes the driving state of the own vehicle acquired from the in-vehicle device 1301 by the recognition unit 1101, and has overtaken the vehicle 10F running ahead, for example. The success probability of the case can be displayed on the display unit 1401 to notify the driver. The overtaking success probability is calculated by the recognition unit 1101 based on, for example, the speed of the host vehicle, the driving skill level of the driver (user), the speed of the target vehicle 10F, the presence of other vehicles in front of the vehicle 10F or in the overtaking lane, and the like. Is done.
In the illustrated example, for example, a notification image 57 indicating the success probability of passing the host vehicle (vehicle 10A) is displayed on the Top View screen on the display device 1401a installed in the vehicle 10A. In addition, traveling navigation for overtaking is displayed with arrows. As a result, the driver can easily grasp his / her driving situation recognition result, and can perform a safer response such as stopping overtaking when the overtaking success probability is low. Passing success probability is, for example, when the driver's line of sight confirms the vehicle running ahead, the overtaking lane and the back of the overtaking lane, or when saying `` This car is slow '' while paying attention to the vehicle running ahead The estimation unit 1105 can estimate that information regarding overtaking is appropriate for the current driver and can be displayed on the display unit 1401.
FIG. 26 and FIG. 27 are diagrams illustrating warning notification based on information acquired from other nearby vehicles. In both FIG. 26 and FIG. 27, the warning notification is displayed as AR on the windshield 1401A of the vehicle 10A. These warning notifications are presented based on the recognition result received from the other vehicle by the inter-vehicle communication unit 1201 or the like.
In the example shown in FIG. 26, it is transmitted as a recognition result from the information processing apparatus 100 mounted on the vehicle 10H that the vehicle 10G entering from the oncoming vehicle train that is stopped on the right side is a vehicle that makes a sudden interruption, On the windshield 1401A of the vehicle 10A, a notification image 58 indicating a warning regarding the vehicle 10G is displayed as an AR. The information processing apparatus 100 mounted on the vehicle 10G recognizes the driver's behavior based on information obtained from the in-vehicle device 1301 or the sensor 1302 by the recognition unit 1101, and the recognition control unit 1104 transmits the recognition result to inter-vehicle communication or the like. By sending to nearby vehicles.
In addition, in the vehicle 10H traveling ahead, it is predicted and recognized that sudden braking or sudden lane change is performed in order to avoid contact with the vehicle 10G that makes a sudden interruption from the right side, and the recognition result is transmitted to surrounding vehicles. Sent by inter-vehicle communication or the like. The information processing apparatus 100 of the vehicle 10A that has received the recognition result AR displays a notification image 59 indicating a warning regarding the vehicle 10H on the windshield 1401A as shown in FIG.
In addition, as shown in FIG. 27, a notification image 60 that warns that the vehicle I traveling in the right lane has not joined the car insurance may be displayed in an AR display on the windshield 1401A of the vehicle 10A. By displaying the vehicle profile such as car insurance subscription information, the driver can be alerted. Such information can be acquired from the target vehicle I.
In addition, as shown in FIG. 27, when the driver of the vehicle 10J in the blind spot is in a sleepy state, the dangerous driving that goes straight through the intersection is predicted and recognized by the vehicle 10J, and when the recognition result is received, the information processing device of the vehicle 10A 100 displays AR on the windshield 1401A as a notification image 62 indicating a warning regarding the vehicle 10J in the blind spot.
As described above, in the information processing system according to the present embodiment, dangerous driving (sudden interruption, lane change, sudden braking, overspeed limit, sudden acceleration, approach of the following vehicle, drowning, dozing operation, etc.) in other vehicles, When the occurrence of an accident is predicted, the user (driver) can be alerted by warning the danger of another vehicle in the user vehicle. The warning notification method is not limited to display, and a warning sound may be emitted from the speaker 1402.
In the fifth embodiment described above, the recognition result is received from the other vehicle and a warning is given, but this embodiment is not limited to this, and the captured image of the other vehicle captured by the camera provided in the own vehicle. The recognition unit 1101 may predict and recognize a dangerous driving of another vehicle based on the analysis result such as, and may warn.
<3-6. Sixth Embodiment>
Subsequently, an information processing system according to the sixth embodiment will be described with reference to FIGS. 28 to 32. In the sixth embodiment, a case will be described in which vehicle information is disclosed and used by others via a network.
FIG. 28 is a diagram for explaining the overall configuration of an information processing system according to the sixth embodiment. As illustrated in FIG. 28, the information processing system according to the present embodiment includes a roadside apparatus 3 that performs wireless communication with each vehicle 10 (specifically, for example, the vehicles 10 </ b> A to 10 </ b> E), a management server 4, and a communication terminal 6. Including. The management server 4 appropriately transmits information acquired from the vehicle 10 via the roadside apparatus 3 (hereinafter also referred to as vehicle information) to the communication terminal 6 via the network 5. As the communication terminal 6, for example, a smartphone 6A, a smart watch 6B, a tablet terminal 6C, or a PC (personal computer) 6D is assumed. Hereinafter, a method for utilizing vehicle information will be described with reference to FIGS.
FIG. 29 is a diagram for explaining a case where an important driving situation of a close relative is notified. In the illustrated example, the fact that the son is driving dangerously in the parent car is displayed on the parent smart watch 6B. That is, the management server 4 determines whether or not it is dangerous driving (overspeed, neglect of signal, meandering, etc.) based on the driving content included in the vehicle information acquired from the vehicle 10, and registers in the case of dangerous driving. To the communication terminal of the notified destination (parent or car owner). Note that the recognition unit 1101 of the information processing apparatus 100 mounted on the vehicle can identify the driver. For example, the recognition unit 1101 recognizes a driver's face image captured by a fingerprint sensor provided on a steering wheel or a camera, or The driver is identified based on personal authentication or the like by a communication terminal such as a smartphone owned by the driver, and transmitted to the management server 4 together with the vehicle information.
In this way, for example, when a parent rents a car to his son or daughter, it can be confirmed whether dangerous driving is done, and the borrower is notified to the parent when dangerous driving is done. Can be expected to drive carefully.
FIGS. 30 and 31 are diagrams illustrating a case where the driving status of each user is automatically posted to SNS (Social Networking Service). For example, in the example shown in FIG. 30, the current driving status of the registered friend or acquaintance is posted on the smartphone 6A as a single comment at any time. An icon indicating the driving situation can also be displayed. In the example shown in FIG. 31, data related to the current driving status of friends and acquaintances registered in the tablet terminal 6C (for example, departure place, destination, number of sudden accelerations, number of sudden handles, average hourly speed, average fuel consumption, etc.) Will be posted from time to time. In any case, the management server 4 implement | achieves by posting the driving condition contained in the vehicle information acquired from the vehicle 10 to the registered specific SNS.
In this way, by disclosing the driving situation on the SNS, it is possible to grasp and enjoy each other's driving contents, and since the own driving situation is disclosed, the user tries to be more careful driving. It is expected that
FIG. 32 is a diagram for explaining a case where driving contents are reflected in a game. In the example shown in FIG. 32, the result of scoring the driving content included in the vehicle information acquired from the vehicle is displayed on the smartphone 6A. Such a score is shared with registered friends and acquaintances, and it is possible to promote safe driving by competing for the score. The scoring of driving details is given by, for example, the score according to the continuation of safe driving (“Sudden braking, traveling 10 km without rapid acceleration”, “Sudden braking, traveling 100 km without rapid acceleration”, etc.) There may be. For example, when the management server 4 acquires vehicle information from a predetermined vehicle participating in the game, the driving content included in the vehicle information is scored and shared within the registered group (that is, to a registered friend or acquaintance). .
<< 4. Supplement >>
Each embodiment described above will be supplemented below.
For example, the evaluation in the first embodiment is not limited to the evaluation from an automobile or a motorcycle to an automobile, but may be an evaluation from a bicycle or a pedestrian to an automobile / motorcycle. Further, the evaluation information of the target vehicle may be presented to a bicycle or a pedestrian.
In addition, in the information processing system according to the present embodiment, a vehicle with extremely poor evaluation (for example, a risk recognized by a plurality of users) may be forcibly switched to the automatic driving mode and moved to a parking lot or the like.
In addition, the information processing system according to the present embodiment may receive a cash back of insurance premiums according to accumulated driver evaluation information.
In addition, the information processing system according to the present embodiment stores a captured image obtained by imaging the driving situation of the host vehicle and the surrounding situation when evaluated from another vehicle in association with the evaluation so that it can be reproduced later. Also good.
In addition, the information processing system according to the present embodiment verifies the consistency between the evaluation information for the own vehicle and the driving state of the own vehicle, and notifies the driver of the evaluation with low reliability in order to prevent inappropriate evaluation. You may make it not. In addition, the information processing system learns the probability of evaluation execution according to the driving situation from the relationship between the past driving situation and evaluation execution, and does not display the evaluation from other vehicles performed when the execution probability is low. May be.
Further, the information processing system according to the present embodiment may allow the driver to select the type of evaluation information to be displayed. In addition, the information processing system can learn the driver's feedback when presenting information estimated to be known by the driver, and can also improve the estimation accuracy.
Further, the display method of the accumulated evaluation information of other vehicles is not limited to the above-described example. For example, the information processing system according to the present embodiment determines the superiority and risk of other vehicles based on the evaluation information, the number of stars, You may display with a skull mark etc. In addition, the information processing system according to the present embodiment clearly indicates to the driver the text of the vehicle that is determined to be dangerous, such as meandering, sleepiness, low concentration, short distance between vehicles, etc. You may do it. Moreover, the displayed evaluation comment of the other vehicle is not limited to the latest evaluation comment, and for example, a plurality of comments may be sequentially switched (for example, Ticker method) and displayed.
In addition, the information processing system according to the present embodiment may display the types of actions (direction indicators, hazards, horns, passing, etc.) of other vehicles as icons and animations as other vehicle information. In addition, when a horn is sounded at a distant place, the driver does not know which car horned, but the information processing system according to the present embodiment has information on other vehicles around the car that horned. Can be recognized and presented to the driver on the Top View screen.
In addition, the information processing system according to the present embodiment may notify the driver of multiple types of information by combining the above-described embodiments. For example, the evaluation information and speed information of surrounding vehicles may be displayed together. In addition, information display priorities may be given according to driving conditions and surrounding conditions so that high priority items are displayed. For example, at an intersection, information useful for preventing an accident assumed at the intersection is preferentially displayed.
<< 5. Hardware configuration example >>
The technology according to the present disclosure can be applied to various products. For example, the information processing apparatus 100 may be realized as an apparatus mounted on any type of vehicle such as an automobile, an electric vehicle, a hybrid electric vehicle, and a motorcycle. Further, at least a part of the components of the information processing apparatus 100 may be realized in a module for an apparatus mounted on a vehicle (for example, an integrated circuit module configured by one die).
<5-1. Configuration example of vehicle control system>
FIG. 33 is a block diagram illustrating an example of a schematic configuration of a vehicle control system 900 to which the technology according to the present disclosure can be applied. The vehicle control system 900 includes an electronic control unit 902, a storage device 904, an input device 906, an out-of-vehicle sensor 908, a vehicle state sensor 910, a passenger sensor 912, a communication IF 914, an output device 916, a power generation device 918, a braking device 920, a steering. 922 and a lamp actuating device 924.
The electronic control unit 902 functions as an arithmetic processing device and a control device, and controls the overall operation in the vehicle control system 900 according to various programs. The electronic control unit 902 can be formed as an ECU (Electronic Control Unit) together with a storage device 904 described later. A plurality of ECUs (that is, the electronic control unit 902 and the storage device 904) may be included in the vehicle control system 900. For example, each of the various sensors or the various drive systems may be provided with an ECU for controlling them, and further provided with an ECU for controlling the plurality of ECUs in a coordinated manner. The plurality of ECUs are connected via an in-vehicle communication network conforming to an arbitrary standard such as CAN (Controller Area Network), LIN (Local Interconnect Network), LAN (Local Area Network), or Flexray. The electronic control unit 902 can form, for example, the control unit 110 shown in FIG.
The storage device 904 is a data storage device formed as an example of a storage unit of the vehicle control system 900. The storage apparatus 904 is realized by, for example, a magnetic storage device such as an HDD, a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like. The storage device 904 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 904 stores programs executed by the electronic control unit 902, various data, various data acquired from the outside, and the like. The storage device 904 can form, for example, the storage unit 150 illustrated in FIG.
The input device 906 is realized by a device in which information is input by a passenger (driver or passenger) such as a mouse, a keyboard, a touch panel, a button, a microphone, a switch, and a lever. The input device 906 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device such as a mobile phone or a PDA corresponding to the operation of the vehicle control system 900. . In addition, the input device 906 may be a camera, for example, and in that case, the passenger can input information by gesture. Further, the input device 906 may include, for example, an input control circuit that generates an input signal based on information input by the user using the above-described input means and outputs the input signal to the electronic control unit 902. The passenger can operate the input device 906 to input various data to the vehicle control system 900 and to instruct processing operations. The input device 906 can form, for example, the input unit 130 shown in FIG.
The vehicle outside sensor 908 is realized by a sensor that detects information outside the vehicle. For example, the outside sensor 908 includes a sonar device, a radar device, a LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) device, a camera, a stereo camera, a ToF (Time Of Flight) camera, an infrared sensor, an environmental sensor, a microphone, and the like. May be included. The vehicle exterior sensor 908 may form, for example, the sensor 1302 shown in FIG.
The vehicle state sensor 910 is realized by a sensor that detects information related to the vehicle state. For example, the vehicle state sensor 910 may include a sensor that detects an operation by the driver such as an accelerator opening, a brake depression pressure, or a steering angle. The vehicle state sensor 910 may include a sensor that detects the state of the power source, such as the rotational speed or torque of the internal combustion engine or motor. Further, the vehicle state sensor 910 may include a sensor for detecting information related to the movement of the vehicle such as a gyro sensor or an acceleration sensor. Further, the vehicle state sensor 910 receives a GNSS signal (for example, a GPS signal from a GPS (Global Positioning System) satellite) from a GNSS (Global Navigation Satellite System) satellite and receives position information including the latitude, longitude, and altitude of the device. A GNSS module may be included. In addition, regarding position information, the vehicle state sensor 910 may detect the position by transmission / reception with Wi-Fi (registered trademark), a mobile phone / PHS / smartphone, or near-field communication. The vehicle state sensor 910 can form, for example, the in-vehicle device 1301 shown in FIG.
The passenger sensor 912 is realized by a sensor that detects information related to the passenger. For example, the passenger sensor 912 may include a camera, a microphone, and an environment sensor provided in the vehicle. The passenger sensor 912 may include a biological sensor that detects biological information of the passenger. The biometric sensor is provided on, for example, a seat surface or a steering wheel, and can detect biometric information of a passenger sitting on the seat or a driver who holds the steering wheel. The occupant sensor 912 may form, for example, the sensor 1302 shown in FIG.
Various sensors such as the outside sensor 908, the vehicle state sensor 910, and the passenger sensor 912 each output information indicating the detection result to the electronic control unit 902. These various sensors may set a sensing range or accuracy based on control by the electronic control unit 902. These various sensors include a recognition module that performs recognition processing based on raw data such as processing for recognizing the traveling position of the host vehicle on the road based on the position of the white line included in the captured image. Also good.
The communication IF 914 is a communication interface that mediates communication with other devices by the vehicle control system 900. The communication IF 914 may include, for example, a V2X communication module. Note that V2X communication is a concept that includes vehicle-to-vehicle communication and vehicle-to-vehicle communication. In addition, the communication IF 914 includes a wireless local area network (LAN), Wi-Fi (registered trademark), 3G, LTE (Long Term Evolution), Bluetooth (registered trademark), NFC (Near Field Communication), or WUSB (Wireless USB). ) Communication module. The communication IF 914 can transmit and receive signals and the like according to a predetermined protocol such as TCP / IP, for example, with the Internet or a communication device outside the vehicle. The communication IF 914 can form, for example, the communication unit 120 illustrated in FIG.
The output device 916 is realized by a device capable of visually or audibly notifying acquired information to a passenger. Such devices include display devices such as instrument panels, head-up displays, projectors or lamps, and audio output devices such as speakers or headphones. Specifically, the display device visually displays the results obtained by various processes performed by the vehicle control system 900 in various formats such as text, images, tables, and graphs. At this time, a virtual object such as an AR (Augmented Reality) object may be displayed. On the other hand, the audio output device converts an audio signal composed of reproduced audio data, acoustic data, and the like into an analog signal and outputs it aurally. The display device and the audio output device can form, for example, the output unit 140 shown in FIG.
The power generation device 918 is a device for generating a driving force of the vehicle. The power generation device 918 may be realized by an internal combustion engine, for example. In that case, the power generation device 918 performs start control, stop control, throttle valve opening control, fuel injection control, EGR (Exhaust Gas Recirculation) control, and the like based on a control command from the electronic control unit 902. . The power generation device 918 may be realized by, for example, a motor, an inverter, and a battery. In that case, the power generation device 918 supplies electric power from the battery to the motor via the inverter based on a control command from the electronic control unit 902 and outputs a positive torque, so-called power running, and torque to the motor. And a regenerative operation of charging the battery via an inverter.
The braking device 920 is a device for applying a braking force to the vehicle, or decelerating or stopping the vehicle. The braking device 920 may include, for example, a brake installed on each wheel, a brake pipe or an electric circuit for transmitting the depression pressure of the brake pedal to the brake, and the like. The braking device 920 may include a control device for operating a sliding or skid prevention mechanism by brake control such as ABS (Antilock Brake System) or ESC (Electronic Stability Control).
The steering 922 is a device for controlling the traveling direction (steering angle) of the vehicle. The steering 922 can include, for example, a steering wheel, a steering shaft, a steering gear, and a tie rod. In addition, the steering 922 may include power steering for assisting steering by the driver. Further, the steering 922 may include a power source such as a motor for realizing automatic steering.
The lamp operating device 924 is a device that operates various lamps such as a headlight, a blinker, a vehicle width lamp, a fog light, or a stop lamp. The lamp operating device 924 controls, for example, the blinking of the lamp, the amount of light, or the irradiation direction.
The power generation device 918, the braking device 920, the steering 922, and the lamp operation device 924 may operate based on a manual operation by a driver or may operate based on an automatic operation by the electronic control unit 902. .
<5-2. Configuration example of information processing apparatus>
FIG. 34 is a block diagram illustrating an example of a hardware configuration of the information processing apparatus according to the present embodiment. Note that the information processing apparatus 1000 illustrated in FIG. 34 can implement the management server 4 illustrated in FIG. 28, for example. Information processing by the management server 28 according to the present embodiment is realized by cooperation of software and hardware described below.
As shown in FIG. 34, the information processing apparatus 1000 includes a CPU (Central Processing Unit) 1001, a ROM (Read Only Memory) 1002, a RAM (Random Access Memory) 1003, and a host bus 1004a. The information processing apparatus 1000 includes a bridge 1004, an external bus 1004b, an interface 1005, an input device 1006, an output device 1007, a storage device 1008, a drive 1009, a connection port 1011, and a communication device 1013. The information processing apparatus 1000 may include a processing circuit such as a DSP or an ASIC in place of or in addition to the CPU 1001.
The CPU 1001 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing apparatus 1000 according to various programs. Further, the CPU 1001 may be a microprocessor. The ROM 1002 stores programs, calculation parameters, and the like used by the CPU 1001. The RAM 1003 temporarily stores programs used in the execution of the CPU 1001, parameters that change as appropriate during the execution, and the like.
The CPU 1001, the ROM 1002, and the RAM 1003 are connected to each other by a host bus 1004a including a CPU bus. The host bus 1004a is connected to an external bus 1004b such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 1004. Note that the host bus 1004a, the bridge 1004, and the external bus 1004b are not necessarily configured separately, and these functions may be mounted on one bus.
The input device 1006 is realized by a device that inputs information by the user, such as a mouse, a keyboard, a touch panel, a button, a microphone, a switch, and a lever. The input device 1006 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device such as a mobile phone or a PDA that supports the operation of the information processing device 1000. . Furthermore, the input device 1006 may include, for example, an input control circuit that generates an input signal based on information input by the user using the above input means and outputs the input signal to the CPU 1001. The user of the information processing apparatus 1000 can input various data and instruct processing operations to the information processing apparatus 1000 by operating the input device 1006.
The output device 1007 is formed by a device capable of visually or audibly notifying acquired information to the user. Such devices include CRT display devices, liquid crystal display devices, plasma display devices, EL display devices, display devices such as laser projectors, LED projectors and lamps, audio output devices such as speakers and headphones, and printer devices. . For example, the output device 1007 outputs results obtained by various processes performed by the information processing apparatus 1000. Specifically, the display device visually displays the results obtained by various processes performed by the information processing device 1000 in various formats such as text, images, tables, and graphs. On the other hand, the audio output device converts an audio signal composed of reproduced audio data, acoustic data, and the like into an analog signal and outputs it aurally.
The storage device 1008 is a data storage device formed as an example of a storage unit of the information processing device 1000. The storage apparatus 1008 is realized by, for example, a magnetic storage device such as an HDD, a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like. The storage device 1008 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 1008 stores programs executed by the CPU 1001, various data, various data acquired from the outside, and the like.
The drive 1009 is a storage medium reader / writer, and is built in or externally attached to the information processing apparatus 1000. The drive 1009 reads information recorded on a mounted removable storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 1003. The drive 1009 can also write information on a removable storage medium.
The connection port 1011 is an interface connected to an external device, and is a connection port with an external device that can transmit data by USB (Universal Serial Bus), for example.
The communication device 1013 is a communication interface formed by a communication device or the like for connecting to the network 1020, for example. The communication device 1013 is, for example, a communication card for a wired or wireless LAN (Local Area Network), LTE (Long Term Evolution), Bluetooth (registered trademark), or WUSB (Wireless USB). Further, the communication device 1013 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various communication, or the like. The communication device 1013 can transmit and receive signals and the like according to a predetermined protocol such as TCP / IP, for example, with the Internet or other communication devices.
The network 1020 is a wired or wireless transmission path for information transmitted from a device connected to the network 1020. For example, the network 1020 may include a public line network such as the Internet, a telephone line network, a satellite communication network, various local area networks (LANs) including the Ethernet (registered trademark), a wide area network (WAN), and the like. The network 1020 may include a dedicated line network such as an IP-VPN (Internet Protocol-Virtual Private Network).
<5-3. Other>
Heretofore, an example of the hardware configuration capable of realizing the functions of the information processing apparatus 100 or the management server 28 according to the present embodiment has been shown. Each of the above components may be realized using a general-purpose member, or may be realized by hardware specialized for the function of each component. Therefore, it is possible to change the hardware configuration to be used as appropriate according to the technical level at the time of carrying out this embodiment.
Note that a computer program for realizing each function of the information processing apparatus 100 or the management server 28 according to the present embodiment as described above can be produced and installed in an ECU or the like. In addition, a computer-readable recording medium storing such a computer program can be provided. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. Further, the above computer program may be distributed via a network, for example, without using a recording medium.
<< 6. Summary >>
The embodiment of the present disclosure has been described in detail above with reference to FIGS. As described above, in the information processing system according to the embodiment of the present disclosure, it is possible to effectively use information related to user evaluation for the target vehicle.
That is, since the evaluation information of the own vehicle is disclosed to other vehicles, it is possible to expect a sufficient effect for motivation to try good driving, which is insufficient only by grasping the own evaluation. In addition, by knowing the evaluation information of other vehicles, accidents can be prevented and comfortable driving can be performed.
Further, in the information processing system according to the embodiment of the present disclosure, the information on other vehicles is not limited to evaluation information, but includes speed information, acceleration / deceleration information, recognition information, behavior prediction recognition results, departure place / destination, car insurance participation information. It is also possible to acquire a vehicle profile such as the above, a driver profile, etc., and present it to the user.
For example, a computer program for causing the information processing apparatus 100 or the management server 4 to perform the functions of the information processing apparatus 100 or the management server 4 on hardware such as a CPU, a ROM, and a RAM built in the management server 4 can be created. It is. A computer-readable storage medium storing the computer program is also provided.
Moreover, a part of function by the control part 110 of the information processing apparatus 100 shown in FIG. 2 may exist in the management server 4 side.
Further, the configuration of the information processing apparatus 100 illustrated in FIGS. 2 and 3 is an example, and the present embodiment is not limited to this. For example, when the information processing apparatus 100 is realized by a smartphone, a tablet terminal, or the like, among the configurations illustrated in FIG. The unit 120 is provided on the vehicle side. In this case, the information processing apparatus 100 acquires and processes various information from the in-vehicle device 1301, the sensor 1302, the operation input unit 1303, and the microphone 1304 provided on the vehicle side, and displays the information provided on the vehicle side. Control is performed such that notification to the user from the unit 1401 or the speaker 1402 and data transmission / reception to / from the outside from the communication unit 120 provided on the vehicle side are performed.
A recognition unit that automatically recognizes information on the target vehicle from the user's environmental information;
An acquisition unit for acquiring a user evaluation for the recognized target vehicle;
A generating unit that generates information for notifying the acquired user evaluation;
The recognition unit recognizes the target vehicle based on information from a sensor provided in the user vehicle,
An other user evaluation acquisition unit for acquiring information on evaluation from other users regarding the target vehicle recognized by the recognition unit;
The information processing apparatus according to (1), further comprising: a notification control unit that controls the user vehicle to notify the acquired predetermined information to the user.
The information processing apparatus according to (2), wherein the other user evaluation acquisition unit acquires information received from the target vehicle through inter-vehicle communication.
The information generated by the generation unit is the information processing apparatus according to (2) or (3), in which at least one of an evaluator, an evaluated person, and a neighboring third party is notified.
The recognizing unit is based on line-of-sight information, peripheral information, a positional relationship between the user vehicle and surrounding vehicles, a user's concentration degree, a driving situation of the user vehicle, or a user's utterance content included in the user's environment information. The information processing apparatus according to any one of (2) to (4), wherein a target vehicle that is a user evaluation target is automatically recognized.
The information processing apparatus according to any one of (2) to (5), wherein the acquisition unit acquires user evaluation based on an operation input by a user, a voice input, or a driving operation.
The information processing apparatus according to any one of (2) to (6), wherein the notification control unit performs control to notify from a display device or an audio output device that is visible by a user provided in a vehicle.
An estimation unit for estimating what information about the recognized target vehicle should be notified to the current driver;
The information processing apparatus according to any one of (2) to (7), further including an acquisition control unit that controls to acquire information estimated by the estimation unit from the target vehicle.
Information acquired from the target vehicle includes information on evaluation of the target vehicle from other users, speed information of the target vehicle, acceleration / deceleration information of the target vehicle, recognition information on the user vehicle in the target vehicle, and the target The information processing apparatus according to (8), which is at least one of a vehicle travel prediction recognition result and a profile.
The notification control unit performs display control so that information acquired from the target vehicle is visually recognized corresponding to the target vehicle in a display device provided in the vehicle and visible by a user. Information processing device.
The information processing apparatus according to (9) or (10), wherein the notification control unit performs control so as to issue a warning to a user based on information acquired from the target vehicle.
The information processing apparatus according to any one of (9) to (11), wherein the notification control unit performs control so as to notify a travel prediction result of the user vehicle based on information acquired from the target vehicle.
The notification control unit notifies the user in real time of the evaluation content performed on the target vehicle, the evaluation content performed on the user vehicle from another user, or the evaluation content performed on the other vehicle from the other user. The information processing apparatus according to any one of (2) to (12), which is controlled.
The information processing apparatus according to any one of (2) to (13), further including a transmission control unit that controls to transmit a driving situation of the user vehicle to a server on the network.
The information processing apparatus according to (2), wherein the acquisition unit acquires user evaluation of the target vehicle by a pedestrian or a bicycle driver.
The generation unit generates information for performing a notification requesting an evaluation to the user based on at least one of the information related to the target vehicle and the user's environment information. (2) to (15) The information processing apparatus according to any one of claims.
The information processing unit according to any one of (2) to (16), wherein the generation unit generates a reason for the user evaluation based on at least one of information on the target vehicle and user environment information. apparatus.
Automatically recognizing target vehicle information from the user's environmental information;
Obtaining a user evaluation for the recognized target vehicle;
Generating information for notifying the acquired user evaluation;
Program to function as
DESCRIPTION OF SYMBOLS 100 Information processing apparatus 110 Control part 1101 Recognition part 1102 User evaluation acquisition part 1103 Notification information generation part 1104 Notification control part 120 Communication part 1201 Inter-vehicle communication part 1202 Road-to-vehicle communication part 1203 Network I / F part 130 Input part 1301 In-vehicle apparatus 1302 Sensor 1303 Operation input unit 1304 Microphone 140 Output unit 1401 Display unit 1402 Speaker 150 Storage unit 10 Vehicle 4 Management server
The information processing apparatus according to claim 1, further comprising: a notification control unit that controls the user vehicle to notify the acquired predetermined information to the user vehicle.
The information processing apparatus according to claim 2, wherein the other user evaluation acquisition unit acquires information received from the target vehicle through inter-vehicle communication.
The information processing apparatus according to claim 2, wherein the information generated by the generation unit is notified to at least one of an evaluator, an evaluated person, and a nearby third party.
The recognizing unit is based on line-of-sight information, peripheral information, a positional relationship between the user vehicle and surrounding vehicles, a user's concentration degree, a driving situation of the user vehicle, or a user's utterance content included in the user's environment information. The information processing apparatus according to claim 2, which automatically recognizes a target vehicle to be a user evaluation target.
The information processing apparatus according to claim 2, wherein the acquisition unit acquires a user evaluation based on a user operation input, a voice input, or a driving operation.
The information processing apparatus according to claim 2, wherein the notification control unit performs control so as to be notified from a display device or a sound output device provided in a vehicle and visible by a user.
An acquisition control unit that controls to acquire information estimated by the estimation unit from the target vehicle;
Information acquired from the target vehicle includes information on evaluation of the target vehicle from other users, speed information of the target vehicle, acceleration / deceleration information of the target vehicle, recognition information on the user vehicle in the target vehicle, and the target The information processing apparatus according to claim 8, wherein the information is at least one of a vehicle travel prediction recognition result and a profile.
9. The notification control unit according to claim 8, wherein the notification control unit performs display control so that information acquired from the target vehicle is visually recognized corresponding to the target vehicle in a display device provided in a vehicle and visible by a user. Information processing device.
The information processing apparatus according to claim 9, wherein the notification control unit controls to give a warning to a user based on information acquired from the target vehicle.
The information processing apparatus according to claim 9, wherein the notification control unit controls to notify a travel prediction result of the user vehicle based on information acquired from the target vehicle.
The notification control unit notifies the user in real time of the evaluation content performed on the target vehicle, the evaluation content performed on the user vehicle from another user, or the evaluation content performed on the other vehicle from the other user. The information processing apparatus according to claim 2, which is controlled.
The information processing apparatus according to claim 2, further comprising a transmission control unit that controls to transmit a driving situation of the user vehicle to a server on the network.
The information processing apparatus according to claim 2, wherein the acquisition unit acquires a user evaluation for the target vehicle by a pedestrian or a bicycle driver.
The information processing apparatus according to claim 2, wherein the generation unit generates information for performing a notification requesting an evaluation to the user based on at least one of information regarding the target vehicle and user environment information. .
The information processing apparatus according to claim 2, wherein the generation unit generates the reason for the user evaluation based on at least one of information on the target vehicle and user environment information.
JP2016067568A 2015-09-18 2016-06-13 Information processing apparatus, information processing method, and program Pending JPWO2017047176A1 (en)
JP2015185362 2015-09-18
PCT/JP2016/067568 WO2017047176A1 (en) 2015-09-18 2016-06-13 Information processing device, information processing method, and program
JPWO2017047176A1 true JPWO2017047176A1 (en) 2018-06-28
ID=58288657
JP2016067568A Pending JPWO2017047176A1 (en) 2015-09-18 2016-06-13 Information processing apparatus, information processing method, and program
US (2) US10380888B2 (en)
EP (1) EP3352154A4 (en)
JP (1) JPWO2017047176A1 (en)
CN (1) CN108028015A (en)
WO (1) WO2017047176A1 (en)
JP2016218732A (en) * 2015-05-20 2016-12-22 修一 田山 Automobile peripheral information display system
JPWO2018225178A1 (en) * 2017-06-07 2019-11-07 三菱電機株式会社 Dangerous vehicle prediction device, dangerous vehicle warning system, and dangerous vehicle prediction method
JP2019159492A (en) * 2018-03-08 2019-09-19 東芝デジタルソリューションズ株式会社 Rank traveling operation system and rank traveling operation method
JP2001034897A (en) * 1999-07-21 2001-02-09 Toyota Central Res & Dev Lab Inc Driving support system
JP4655730B2 (en) * 2005-04-07 2011-03-23 トヨタ自動車株式会社 Vehicle driving support device
JP2008126954A (en) 2006-11-24 2008-06-05 Tokai Rika Co Ltd Intention transmitting device
JP2012150557A (en) 2011-01-17 2012-08-09 Toyota Central R&D Labs Inc Driving manner cultivation device, system, and program
JP5621682B2 (en) 2011-03-29 2014-11-12 株式会社デンソー In-vehicle information presentation device
JP2012252407A (en) 2011-05-31 2012-12-20 Nissan Motor Co Ltd Passage support device and passage support method for vehicle
JP5974498B2 (en) 2012-01-24 2016-08-23 株式会社デンソー Inter-vehicle communication device
US20140080098A1 (en) * 2012-09-14 2014-03-20 Hyundai Motor Company System and method of evaluating and reporting the driving acuity and performance of a test subject
2016-06-13 JP JP2016067568A patent/JPWO2017047176A1/en active Pending
2016-06-13 EP EP16846049.1A patent/EP3352154A4/en active Pending
2016-06-13 US US15/750,384 patent/US10380888B2/en active Active
2016-06-13 CN CN201680052582.5A patent/CN108028015A/en active Search and Examination
2016-06-13 WO PCT/JP2016/067568 patent/WO2017047176A1/en active Application Filing
2019-07-09 US US16/505,721 patent/US20190333380A1/en active Pending
US20180225963A1 (en) 2018-08-09
CN108028015A (en) 2018-05-11
EP3352154A1 (en) 2018-07-25
US20190333380A1 (en) 2019-10-31
US10380888B2 (en) 2019-08-13
WO2017047176A1 (en) 2017-03-23
EP3352154A4 (en) 2019-08-07
US9505412B2 (en) 2016-11-29 System and method for detection and utilization of driver distraction level
JP2007310729A (en) 2007-11-29 Operation support device for moving body
JP2008186045A (en) 2008-08-14 Driving evaluation apparatus
2019-05-21 A621 Written request for application examination