Patent Publication Number: US-2023134362-A1

Title: Questionnaire apparatus, questionnaire method, and non-transitory computer-readable storage medium

Description:
CROSS-REFERENCE TO RELATED APPLICATION 
     The present application claims priority under 35 U.S.C. § 119 to Japanese Patent Application No. 2021-180579, filed Nov. 4, 2021, the contents of which application are incorporated herein by reference in their entirety. 
     BACKGROUND 
     Field 
     The present disclosure relates to a technique for evaluating autonomous driving performed by an autonomous driving vehicle. 
     Background Art 
     JP2020-052468A discloses a driving evaluation apparatus. The driving evaluation apparatus makes at least one of a device mounted on a vehicle and a mobile terminal of a passenger to display a question for evaluating driving of the vehicle controlled by autonomous driving, and receives an answer from the passenger to the question. 
     SUMMARY 
     As described above, an evaluation apparatus which evaluates autonomous driving performed by an autonomous driving vehicle is known. The evaluation apparatus carries out a questionnaire composed of one or more questions to a passenger of the autonomous driving vehicle and performs evaluation by acquiring one or more answers to the one or more questions. If the number of the questions composing the questionnaire is large, there is a possibility that a burden on the passenger increases. On the other hand, if the number of the questions is small, there is a possibility that many of the questions composing the questionnaire become general questions, and questions desired by the user of the evaluation apparatus are not included in the questionnaire. 
     An object of the present disclosure is to provide a technique, relating to the evaluation apparatus which evaluates autonomous driving performed by the autonomous driving vehicle, which enables carrying out a questionnaire composed of one or more appropriate questions while reducing the number of questions. 
     The first aspect relates to a questionnaire apparatus. 
     The questionnaire apparatus includes: 
     A question management unit configured to manage one or more questions prepared for a passenger of an autonomous driving vehicle to evaluate autonomous driving performed by the autonomous driving vehicle; 
     An information acquisition unit configured to acquire driving environment information and driving state information related to the autonomous driving; and 
     A question determination unit configured to determine one or more request questions for requesting an answer from the passenger from among one or more managed questions based on at least one of the driving environment information and the driving state information. 
     The second aspect relates to a questionnaire method. 
     The questionnaire method includes: 
     Managing one or more questions prepared for a passenger of an autonomous driving vehicle to evaluate autonomous driving performed by the autonomous driving vehicle; 
     Acquiring driving environment information and driving state information related to the autonomous driving; and 
     Determining one or more request questions for requesting an answer from the passenger from among one or more managed questions based on at least one of the driving environment information and the driving state information. 
     The third aspect relates to a program to be executed by a computer. 
     The program may be stored in a non-transitory computer-readable storage medium. 
     The program causes a computer to execute the questionnaire method according to the second aspect. 
     According to the present disclosure, the contents of the one or more questions is changed in accordance with the driving environment or the driving state of the vehicle. Specifically, based on the driving environment information and the driving state information of the vehicle, the one or more questions to which the passenger is requested to answer are determined from among all the questions. Therefore, it is possible to carry out a questionnaire composed of one or more appropriate questions while reducing the number of questions. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG.  1    is a block diagram illustrating an example of a configuration of an evaluation apparatus according to an embodiment of the present disclosure. 
         FIG.  2    is a block diagram illustrating an example of a functional configuration of an evaluation apparatus according to an embodiment of the present disclosure. 
         FIG.  3    is a flowchart illustrating the first example of a process executed by an evaluation apparatus according to an embodiment of the present disclosure. 
         FIG.  4    is a flowchart illustrating the second example of a process executed by an evaluation apparatus according to an embodiment of the present disclosure. 
         FIG.  5    is a flowchart illustrating the third example of a process executed by an evaluation apparatus according to an embodiment of the present disclosure. 
     
    
    
     DETAILED DESCRIPTION 
     An embodiment of the present disclosure is described with reference to the accompanying drawings. 
     1. Overview 
     An evaluation apparatus according to the present embodiment evaluates autonomous driving performed by an autonomous driving vehicle. The evaluation apparatus carries out a questionnaire composed of one or more questions to a passenger of the autonomous driving vehicle and acquires an answer to a question. Then, the evaluation apparatus according to the present embodiment evaluates the autonomous driving based on one or more acquired answers and outputs the result of the evaluation. A user of the evaluation apparatus is assumed to be, for example, a developer of the autonomous driving vehicle. The developer can utilize the result of the evaluation by the evaluation apparatus, for example, in development to improve the function of the autonomous driving vehicle. 
     The questionnaire includes one or more questions related to a particular scene affected by driving environment or a driving state of the vehicle. Examples of a question related to a particular scene include a question such as “Was the speed smoothly adjusted in the intersection?” and a question such as “Did you notice any strange behavior when the vehicle passed an oncoming vehicle?” The questionnaire also includes one or more questions that are not affected by a scene. Examples of a question that is not affected by a scene include a question such as “How was the ride quality of the autonomous driving vehicle?”. With respect to a question related to a particular scene such as a scene of driving in an intersection or a scene of passing an oncoming vehicle, there is a possibility that a precise answer cannot be acquired when the passenger does not meet with a scene relating to the question. 
     When the one or more questions composing the questionnaire are made to be questions comprehensively including contents desired by the user of the evaluation apparatus, there is a possibility that the number of the questions increases, or many questions related to a scene with which the passenger does not meet are included. When the user of the evaluation apparatus is the developer of the autonomous vehicle, for example, the developer needs to obtain as much information as possible so as to feed back it into the development. If all the questions desired by the user of the evaluation apparatus are included in the questionnaire to obtain a large amount of information, the number of the questions increases and a burden on the passenger increases. When the burden on the passenger increases, there is a possibility that the response rate of the questionnaire decreases, or it becomes difficult to obtain an appropriate answer. 
     In addition, for example, when a time zone of the driving, a driving place, a movement of a vehicle or a pedestrian around the autonomous driving vehicle, or the like changes, an item desired to be evaluated by the user of the evaluation apparatus also changes because a control state or a behavior of the autonomous driving vehicle changes. However, if all the questions corresponding to the respective control states and behaviors are included in the questionnaire, there is a possibility that the number of questions related to a scene with which the passenger does not meet increases, and an accurate answer cannot be obtained. If an accurate answer cannot be obtained, there is a possibility that the result of the evaluation become biased data, which cannot be utilized. 
     On the other hand, if the one or more questions composing the questionnaire are made to be only the questions that are not affected by a scene, it is possible to reduce the questions related to a scene with which the passenger does not meet. However, the questionnaire becomes general, and there is a possibility that the user of the evaluation apparatus cannot obtain an answer about the desired content. 
     Therefore, the evaluation apparatus according to the present embodiment changes one or more questions to request an answer from the passenger in accordance with the driving environment or the driving state of the vehicle. Specifically, the evaluation apparatus determines one or more questions for requesting an answer from the passenger among one or more questions managed by the evaluation apparatus based on the information about the driving environment or the information about the driving state. This enables to carry out a questionnaire composed of one or more appropriate questions while reducing the number of the questions. 
     A question for requesting an answer from the passenger is hereinafter referred to as a “request question”. The information about the driving environment is hereinafter referred to as “driving environment information”. The information about the driving state is hereinafter referred to as “driving state information”. The driving environment information includes information about a particular situation on a driving route, weather, and details of the service. The driving state information includes information about a control state, a driving place, and a driving course of the vehicle. 
     Examples of a particular situation on the driving route include road blocking due to construction, passage of an ambulance, and the like. As an example of determining a question based on a particular situation on the driving route, a question such as “Did the vehicle take a detour avoiding the road blocking smoothly?” may be determined in a case where there is a road blocking due to construction. 
     As an example of determining a question based on the information about the weather, a question such as “Has there been any scenes that you felt uneasy because of slipping of the tire?” may be determined when the vehicle drives in rainy weather. As another example, a question corresponding to weather may be determined when the weather is fine, foggy, or snowfall. 
     The information about details of the service includes information about a service mode such as on-demand operation or regular operation and information about the entire service such as whether voice guidance is provided or not. As an example of determining a question based on the information about details of the service, a question such as “Wasn&#39;t the voice guidance troublesome?” or “Was the frequency of voice guidance appropriate?” may be determined in a case where the voice guidance is provided during the driving of the vehicle. 
     As an example of determining a question based on the information about the control state of the vehicle, a question such as “Was overtaking smooth?” may be determined in a case where the overtaking occurs during the driving. As another example, a question may be determined in accordance with a particular control state of the vehicle such as rapid acceleration/deceleration, rapid steering, or evacuation driving. 
     When a question is determined based on the information about the driving place, for example, in a case where the driving place includes a particular point, a question related to a phenomenon that is likely to occur at the point may be determined. Examples of a particular point include a point under a bridge, a bus stop, a tunnel, a slope, and an intersection. For example, it is assumed that in a case the vehicle passes under a bridge, a question such as “Didn&#39;t you feel oppressed when passing under the bridge?” is determined. 
     The information about the driving course includes information about on which course the autonomous driving vehicle drives. As an example of determining a question based on the information about a driving course, in a case where the vehicle drives in a predetermined course, a question related to a situation that is likely to occur in the course may be determined. 
     2. Embodiment 
     2-1. Configuration Example of Evaluation Apparatus 
       FIG.  1    is a block diagram illustrating an example of the configuration of the evaluation apparatus according to the present embodiment.  FIG.  1    shows an autonomous driving vehicle  10 , a server  20 , and an answer terminal  30 . The autonomous driving vehicle  10  is an autonomous driving vehicle that is a target of the evaluation of a questionnaire carried out by the evaluation apparatus according to the present embodiment. In the example of  FIG.  1   , the evaluation apparatus according to the present embodiment is configured as the server  20 . However, the evaluation apparatus according to the present embodiment may be an apparatus mounted on the autonomous driving vehicle  10 . The autonomous driving vehicle  10 , the server  20 , and the answer terminal  30  include a communication interface and are configured to be able to communicate with each other via a communication network  40 . The communication network  40  may be a wireless communication network, a wired communication network, or a combination thereof. 
     The autonomous driving vehicle  10  includes a vehicle-state sensor  11 , a recognition sensor  12 , a communication device  13 , and an electronic control unit (ECU)  14 . The vehicle-state sensor  11 , the recognition sensor  12 , and the communication device  13  are configured to be able to communicate with the ECU  14  via a vehicular network. Examples of the vehicle-state sensor  11  include a vehicle speed sensor, a steering angle sensor, a yaw rate sensor, and a lateral acceleration sensor. Examples of the recognition sensor  12  include a camera, a microphone, a temperature-humidity sensor, and a moisture measurement sensor. The communication device  13  communicates with the outside of the vehicle. The communication device  13  may acquire position information of the vehicle using a GPS system, or may acquire operation information, map information, weather information, driving route information, and the like from a management server that manages information related to the vehicle. 
     The ECU  14  calculates information included in the driving state information and the driving environment information. For example, the vehicle-state sensor  11  transmits the vehicle-speed information related to the autonomous driving vehicles  10  to the ECU  14 , and the ECU  14  calculates, based on the transmitted information, whether rapid acceleration/deceleration of the autonomous driving vehicle  10  occurs or not, thereby obtaining the information about the vehicle-control state. In addition, for example, the recognition sensor  12  transmits the temperature and humidity data to the ECU  14 , and the ECU  14  calculates the weather at the time of driving of the autonomous driving vehicle  10  based on the transmitted data. 
     The autonomous driving vehicle  10  transmits the driving state information and the driving environment information to the server  20  via the communication network  40 . The server  20  acquires the driving state information and the driving environment information by a communication device (information acquisition unit), which is not illustrated in  FIG.  1   . 
     The server  20  includes one or more processors  21  (hereinafter simply referred to as the processor  21 ) and one or more storage device (one or more memories)  22  (hereinafter simply referred to as the storage device  22 ). The storage device  22  stores various kinds of information such as one or more questions included in the questionnaire and one or more programs. The one or more programs may be stored in a non-transitory computer-readable storage medium. The processor  21  executes processing for evaluating the autonomous driving performed by the autonomous driving vehicle  10  by executing one or more programs stored in the storage device  22 . 
     The answer terminal  30  includes a display device  31 , an answer input device  32 , and one or more processors  33  (hereinafter simply referred to as the processor  33 ). The display device  31  is a device to output one or more request questions to the passenger. The display device  31  may be a monitor to display the one or more request questions or may be a speaker to output the one or more request question by voice. In the example of  FIG.  1   , the display device  31  is configured as a monitor to display the one or more request questions. The answer input device  32  is a device for inputting an answer to a request question. The answer input device  32  may be, for example, a touch panel, a switch, a microphone to receive an input of an answer by voice, or the like. The processor  33  executes various kinds of processing for displaying the one or more request questions on the display device  31  and acquiring the one or more answers from the answer input device  32 . The answer terminal  30  may be a device mounted on the vehicle or may be a portable terminal such as a mobile phone. 
     The processor  21  executes processing for determining one or more request questions. Then, the server  20  transmits the one or more determined request questions to the answer terminal  30  via the communication network  40 , and the display device  31  outputs the one or more transmitted request questions. One or more answers to the one or more request questions are input into the answer input device  32 , and the answer terminal  30  acquires the one or more input answers. The answer terminal  30  transmits the one or more acquired answers to the server  20  via the communication network  40 . 
     2-2. Example of Functional Configuration of Evaluation Apparatus 
       FIG.  2    is a block diagram illustrating an example of a functional configuration of the evaluation apparatus according to the present embodiment. 
     The autonomous driving vehicle  10  includes a driving environment information unit  15  and a driving state information unit  16 . The driving environment information unit  15  includes a surrounding environment information unit  15   a  and a service mode unit  15   b . The driving state information unit  16  includes an event detection unit  16   a  and a driving position unit  16   b . The server  20  includes a question management unit  23 , a question determination unit  24 , a question transmission unit  25 , and an autonomous driving evaluation unit  26 . The answer terminal  30  includes an output &amp; input unit  34  and an answer transmission unit  35 . 
     The driving environment information unit  15  acquires the driving environment information related to the vehicle. The driving environment information includes information about weather or a particular situation acquired by the surrounding environment information unit  15   a  and information about a service mode acquired by the service mode unit  15   b . The acquisition of the driving environment information is achieved by, for example, the communication device  13  acquiring information about a driving route, weather, and a service mode from the management server. Alternatively, it is achieved by, for example, the temperature-humidity sensor and the moisture measurement sensor, and the ECU  14  estimating weather based on the outputs of the sensors. 
     The driving state information unit  16  acquires the driving state information. The driving state information includes the information about a particular control state of the vehicle acquired by the event detection unit  16   a  and the information about a driving course or a driving position of the vehicle acquired by the driving position unit  16   b . Further, the driving state information may include information about a driving position of the vehicle at the time when a control state of the vehicle becomes a particular state. The event detection unit  16   a  is achieved by, for example, the vehicle-state sensor  11  and an ECU calculating a vehicle control state based on an output of the vehicle-state sensor  11 . The driving position unit  16   b  is achieved by, for example, a GPS-receiving device and an ECU calculating a driving course and a driving position based on an output of the GPS-receiving device. 
     The question management unit  23 , the question determination unit  24 , the question transmission unit  25 , and the autonomous driving evaluation unit  26  are achieved by processing executed by the processor  21 . 
     The question management unit  23  manages the one or more questions composing the questionnaire. The question management unit  23  performs question management such as, for example, storing a question input into the server  20  by the user as a question to be included in the questionnaire in the storage device  22 , or extracting data of a stored question when a request question is determined. The question determination unit  24  determines the one or more request questions from among the one or more questions managed by the question management unit  23  based on the information acquired by the driving environment information unit  15  and the driving state information unit  16 . The question transmission unit  25  transmits the one or more determined request questions to the output &amp; input unit  34 . They may be transmitted immediately before the vehicle arrives at the destination, after the vehicle arrives at the destination, or earlier than the arrival by a predetermined time. In a case where the question transmission unit  25  transmits the one or more request questions at a predetermined timing, the question transmission unit  25  calculates the time at which the vehicle arrives at the destination from the information acquired by the driving position unit  16   b.    
     The autonomous driving evaluation unit  26  receives one or more answers from the answer transmission unit  35 . The autonomous driving evaluation unit  26  evaluates the autonomous driving performed by the autonomous driving vehicle based on the one or more received answers. For example, the autonomous driving evaluation unit  26  adds up the received answers and obtains the result of the evaluation of the autonomous driving. The autonomous driving evaluation unit  26  may further transmit the result of the evaluation to the user of the evaluation apparatus. The server  20  may be configured not to include the autonomous driving evaluation unit  26 . In a case where the server  20  does not include the autonomous driving evaluation unit  26 , it is assumed that, for example, an external server, which is not illustrated in  FIG.  2   , acquires the one or more answers from the answer transmission unit  35  and evaluates the autonomous driving based on the one or more acquired answers. 
     The evaluation apparatus according to the present embodiment may not include the autonomous driving evaluation unit  26 . In this case, the evaluation apparatus outputs the one or more answers to the one or more request questions acquired from the answer transmission unit  35  as the result of the questionnaire. Therefore, in this case, the evaluation apparatus can be referred to as a “questionnaire apparatus”. 
     The output &amp; input unit  34  outputs the one or more request questions to the passenger and acquires one or more answers to the one or more request questions. Outputting of the one or more request questions and the acquisition of the one or more answers may be performed by visual means such as a monitor and a touch panel or may be performed using voice and sound. The output &amp; input unit  34  is achieved by, for example, the display device  31 , the answer input device  32 , and the processor  33 . The answer transmission unit  35  transmits the one or more acquired answers to the autonomous driving evaluation unit  26 . The answer transmission unit  35  is achieved by, for example, the processor  33  controlling transmission of the one or more answers acquired by the answer input device  32  via the communication network  40 . 
     The timing at which the output &amp; input unit  34  outputs the one or more request questions and the timing at which the output &amp; input unit  34  acquires the one or more answers may be before or after the vehicle arrives at the destination. For example, the one or more request questions may be output a predetermined time before arriving at the destination, and the one or more answers may be acquired immediately before arriving. In this case, the passenger answers the questionnaire while riding the vehicle, so that he/she can make better use of him/her time during the autonomous driving. Alternatively, for example, in a case where the answer terminal  30  is a mobile phone of the passenger, the one or more request questions may be output after the vehicle arrives at the destination, and the one or more answers may be acquired later. In this case, the passenger can answer the questionnaire without time limit. 
     2-3. First Modification of Embodiment 
     As the first modification example of the embodiment, it is assumed that a fixed question, which is always determined as a request question, is included in the one or more questions. In the first modification example, one or more fixed questions are included in the one or more questions managed by the question management unit  23 . The question determination unit  24  determines every fixed question as a request question. Other configurations and functional configurations are achieved by the same configurations as the configurations described in 2-1 and the same functional configurations as the functional configurations described in 2-2. A fixed question is assumed to be a question that is not affected by a scene. Examples of a question that is not affected by a scene include a question about an attribute of the passenger such as sex and age, and a question about impression of the whole driving. 
     2-4. Second Modification of Embodiment 
     As the second modification example of the embodiment, it is assumed that a predetermined upper limit is set on the number of the request questions. In the second modification example, the question determination unit  24  prioritizes the one or more questions managed by the question management unit  23 . When the number of the request questions exceeds a predetermined upper limit, the question determination unit  24  determines one or more request questions in descending order of priority so that the number of the request questions is equal to or less than the upper limit. Other configurations and functional configurations are achieved by the same configurations as the configurations described in 2-1 and the same functional configurations as the functional configurations described in 2-2. In the second modification example, the burden on the passenger can be further reduced. 
     2-5. Third Modification of Embodiment 
     As the third modification example of the embodiment, it is assumed that one or more fixed questions are included in the one or more questions, and one or more mandatory questions, to which the passenger necessarily needs to answer, are included in the one or more fixed questions. In the third modification example, if the one or more answers to the one or more mandatory questions are not included in one or more answers received from the answer transmission unit  35 , the autonomous driving evaluation unit  26  does not add up the one or more received answers. Other configurations and functional configurations are achieved by the same configurations as the configurations described in 2-1 and the same functional configurations as the functional configurations described in 2-2. By including one or more mandatory questions, it is possible to obtain a less biased result of the questionnaire. For example, it is assumed that a question such as “Where was a seat position in the vehicle” is made to be a mandatory question, and answers are added up for each seat position. 
     3. Examples of Processing Executed by Evaluation Apparatus 
     Hereinafter, examples of processing executed by the evaluation apparatus according to the present embodiment is described. The first example is an example in which a question is determined based on the information about the details of the service. The second example is an example in which a question is determined based on the information about the driving place. The third example is an example in which a question is determined based on the information about the control state of the vehicle. 
     3-1. First Example 
       FIG.  3    is a flowchart showing the first example of processing executed by the evaluation apparatus according to the present embodiment. In Step S 100 , the information acquiring unit acquires the driving environment information and the driving state information. When the driving environment information and the driving state information are acquired, the processing proceeds to Step S 110 . 
     In Step S 110 , it is determined whether the service mode is regular operation or not. It is determined whether the service mode is regular operation or not, for example, based on information acquired by the service mode unit  15   b  by the question determination unit  24 . When the service mode is regular operation (Step S 110 ; Yes), the processing proceeds to Step S 120 . When the service mode is on-demand operation, which is not regular operation, (Step S 110 ; No), the processing proceeds to Step S 130 . 
     In Step S 120 , the question determination unit  24  determines one or more questions prepared for the case of regular operation as request questions. In Step S 130 , the question determination unit  24  determines one or more questions prepared for the case of on-demand operation as request questions. For example, it is assumed that a question such as “Didn&#39;t you wait too long at the bus stop?” is determined in Step S 120 . In addition, for example, it is assumed that a question such as “Was the selected driving route appropriate?” is determined in Step S 130 . 
     In the first example, the determination in Step S 110  may be performed at the time when the service mode is determined. The question determination unit  24  may execute the processing according to the first example at the time when the service mode is determined or may execute the processing according to the first example at the time when the questionnaire is carried out. 
     3-2. Second Example 
       FIG.  4    is a flowchart showing the second example of processing executed by the evaluation apparatus according to the present embodiment. In Step S 200 , the information acquiring unit acquires the driving environment information and the driving state information. When the driving environment information and the driving state information are acquired, the processing proceeds to Step S 210 . 
     In Step S 210 , it is determined whether there is a tunnel in the driving place of the vehicle or not. It may be determined whether there is a tunnel or not, for example, by the question determination unit  24  based on the driving environment information. Further, it may be determined, for example, by the question determination unit  24  based on GPS information and map information. When there is a tunnel in the driving place of the vehicle (Step S 210 ; Yes), the processing proceeds to Step S 220 . When there are no tunnels (Step S 210 ; No), the processing proceeds to Step S 230 . 
     In Step S 220 , the question determination unit  24  determines one or more questions prepared for a case where there is a tunnel as request questions. Then, the processing proceeds to Step S 230 . 
     In Step S 230 , it is determined whether there is a bus stop in the driving place of the vehicle or not. When there is a bus stop (Step S 230 ; Yes), the processing proceeds to Step S 240 . When there are no bus stops (Step S 230 ; No), the processing proceeds to Step S 250 . 
     In Step S 240 , the question determination unit  24  determines one or more questions prepared for a case where there is a bus stop as request questions. Then, the processing proceeds to step S 250 . 
     In Step S 250 , it is determined whether there is a point at which the vehicle pass under a bridge or not. When there is a point passing under the bridge (Step S 250 ; Yes), the processing proceeds to Step S 260 . When there is no points passing under the bridge (Step S 250 ; No), the process ends. 
     In Step S 260 , the question determination unit  24  determines one or more questions prepared for a case where there is a point passing under a bridge as request questions. 
     In the second example, the determination in Steps S 210 , S 230 , and S 250  may be performed at the time when the route on which the autonomous driving vehicle drives is determined. The question determination unit  24  may execute the process according to the second example at the time when the route on which the autonomous driving vehicle drives is determined, or may execute the process according to the second example at the time when the questionnaire is carried out. 
     3-3. Third Example 
       FIG.  5    is a flowchart showing a third example of processing executed by the evaluation apparatus according to the present embodiment. In Step S 300 , the information acquiring unit acquires the driving environment information and the driving state information. When the driving environment information and the driving state information are acquired, the processing proceeds to Step S 310 . 
     In Step S 310 , it is determined whether rapid deceleration has occurred during the driving of the vehicle or not. It is determined whether rapid deceleration has occurred during the driving of the vehicle or not, for example, by the question determination unit  24  based on the information acquired by the event detection unit  16   a . When rapid deceleration has occurred (Step S 310 ; Yes), the processing proceeds to Step S 320 . When rapid deceleration has not occurred (Step S 310 : No), the processing proceeds to Step S 330 . 
     In Step S 320 , the question determination unit  24  determines one or more questions prepared for a case where rapid deceleration has occurred as request questions. Then, the processing proceeds to Step S 330 . 
     In Step S 330 , it is determined whether overtaking has occurred during the driving of the vehicle or not. When overtaking has occurred (Step S 330 ; Yes), the processing proceeds to Step S 340 . When overtaking has not occurred (Step S 330 ; No), the process ends. 
     In Step S 340 , the question determination unit  24  determines one or more questions prepared for a case where overtaking has occurred as request questions. 
     In the third example, the one or more request questions are determined based on the result of driving actually performed by the autonomous driving vehicle. In a case where the determination of the one or more request questions performed by the question determination unit  24  is performed at regular control intervals, the number of the request questions determined until the vehicle arrives at the destination may increase. The determination of the one or more request questions may be performed immediately before the vehicle arrives at the destination. 
     By the process described in the above examples, it is possible to change the one or more questions composing the questionnaire in accordance with a scene. In the first to third examples, the one or more questions are determined based on one type of information among the information about the particular situation in the driving route, the weather, the details of the service, the control state of the vehicle, the driving place, and the driving course. However, the one or more questions may be determined based on two or more types of information among of the information thereof. 
     4. Effects 
     As described above, the evaluation apparatus according to the present embodiment changes one or more questions of the questionnaire in real time. According to the embodiment of the present disclosure, it is possible to provide a technique that enables carrying out a questionnaire composed of one or more appropriate questions while reducing the number of the questions. As a result, the burden on the passenger can be reduced, and the response rate can be improved, or the possibility of obtaining an accurate answer can be stronger, so that the satisfaction is improved for both the passenger and the user of the evaluation apparatus.