Patent Description:
There is a conventionally known invention in which equipment such as a remote controller is controlled by using a user's voice (Patent Literature <NUM> or <NUM>). In the invention disclosed in Patent Literature <NUM>, the user's voice is recognized and control content corresponding to a user's command is displayed on the remote controller. The user checks the control content displayed on the remote controller, and the control is performed by the user approving the control content.

[Patent Literature <NUM>] <CIT>; [Patent Literature <NUM>] Patent document No. <CIT> discloses an apparatus for processing a voice recognition service in an electronic device such as an automotive infotainment device, which provides a feedback for an extendible active state of a voice recognition service.

However, the invention disclosed in Patent Literature <NUM> has a problem that it takes time until the control is actually performed because the user is required to check and approve the control content.

The present invention has been devised in view of the above problem, and an object of the present invention is to provide an information processing apparatus and an information processing method in which control is stopped only when necessary and control is automatically performed promptly unless a stop instruction is received.

An information processing apparatus and method according to the present invention are defined by the appended independent claims. Specific embodiments are defined by the dependent claims.

According to the present invention, control is stopped only when necessary, and control is automatically performed promptly unless there is a stop instruction.

In the description of the drawings, the same parts are denoted by the same reference numerals and the explanation thereof is omitted.

An example of the configuration of an information processing apparatus <NUM> will be described with reference to <FIG>. This example is not encompassed by the wording of the claims but is considered as useful for understanding the invention. The information processing apparatus <NUM> is mounted in a vehicle as an example. As shown in <FIG>, the information processing apparatus <NUM> includes input devices <NUM>, a controller <NUM>, a database <NUM>, and a speaker <NUM>.

The input devices <NUM> are a generic term for equipment that receives data transmitted from a user riding in the vehicle. As shown in <FIG>, the input devices <NUM> include a microphone <NUM>, a touch panel <NUM>, switches <NUM>, and a camera <NUM>. A user's voice data is input to the microphone <NUM>. The microphone <NUM> is installed near the driver's seat, for example. The touch panel <NUM> receives input through a user's touch operation. The touch panel <NUM> is mainly used as a display of a navigation device. The switches <NUM> are disposed on a steering wheel and receive a user's input (switch on). The camera <NUM> is installed near the driver's seat, for example, and captures images of the posture, gestures, and the like of the user. Data input to the input devices <NUM> is transmitted to the controller <NUM>.

The controller <NUM> is a general-purpose computer having a central processing unit (CPU), a memory, a storage device, an input/output unit, and the like. The controller <NUM> processes data acquired from the input devices <NUM>. Specifically, the CPU reads various programs stored in the storage device into the memory and executes various commands of the program. This causes the controller <NUM> to function as a plurality of information processing circuits of the information processing apparatus <NUM>. The controller <NUM> includes a voice recognition unit <NUM>, a voice output unit <NUM>, a notification end determination unit <NUM>, and a control signal transmission unit <NUM> as the plurality of information processing circuits.

The voice recognition unit <NUM> recognizes the user's voice data input to the microphone <NUM>. Known techniques such as frequency analysis are used for voice recognition. The voice recognition unit <NUM> outputs the recognition result to the voice output unit <NUM>.

The voice output unit <NUM> refers to a database <NUM> and acquires feedback voice data corresponding to the recognition result of the voice recognition unit <NUM>. The feedback voice data is data which prompts the user to confirm the content of control to be performed on predetermined equipment. If the user's voice data is recognized as "Open the driver's seat window", the corresponding feedback voice data would be "Opening the driver's seat window", for example. A plurality of pieces of feedback voice data are prepared in advance and stored in the database <NUM>. In the present embodiment, the database <NUM> is described as being stored in a storage device different from the storage device of the controller <NUM>, but the storage place is not limited to this. The database <NUM> may be stored in the storage device of the controller <NUM>.

The voice output unit <NUM> notifies the user of feedback voice data by using the speaker <NUM>. The voice output unit <NUM> may generate feedback voice data each time based on the recognition result of the voice recognition unit <NUM>. As the generation method, it is sufficient if the device is programmed to generate voice data that responds to the user's voice data in parrot fashion.

When the output of the feedback voice data starts, the voice output unit <NUM> transmits a signal indicating that the output of the data has started to the notification end determination unit <NUM>. When the output of the feedback voice data ends, the voice output unit <NUM> transmits a signal indicating that the output of the data has ended to the notification end determination unit <NUM>. In the following, a signal indicating the start is sometimes simply referred to as a start signal. Similarly, a signal indicating the end is sometimes simply referred to as an end signal.

The notification end determination unit <NUM> determines whether the notification by means of the voice output unit <NUM> has ended. Specifically, if the notification end determination unit <NUM> receives the end signal after receiving the start signal from the voice output unit <NUM>, the notification end determination unit <NUM> determines that the notification by means of the voice output unit <NUM> has ended. Meanwhile, if the notification end determination unit <NUM> has received the start signal from the voice output unit <NUM> but does not receive the end signal thereafter, the notification end determination unit <NUM> determines that the notification by means of the voice output unit <NUM> has not ended. When the notification end determination unit <NUM> determines that the notification by means of the voice output unit <NUM> has ended, the notification end determination unit <NUM> transmits a signal indicating that the notification has ended to the control signal transmission unit <NUM>.

If the control signal transmission unit <NUM> receives a signal indicating that notification has ended from the notification end determination unit <NUM>, the control signal transmission unit <NUM> controls predetermined equipment based on a user's instruction (voice data) obtained by means of the recognition result of the voice recognition unit <NUM>. Predetermined equipment is mounted in the vehicle and includes, as shown in <FIG>, a power window <NUM>, an air conditioner <NUM>, a sunroof <NUM>, a sunshade <NUM>, a power back door <NUM>, a power trunk <NUM>, a navigation device <NUM>, an audio device <NUM>, and the like. As an example, if the user's instruction is "Open the driver's seat window", the control signal transmission unit <NUM> transmits a signal for opening the window to the power window <NUM> of the driver's seat. The power window <NUM> automatically opens the window based on the received signal. The predetermined equipment may include equipment that performs travel control such as automated driving.

Next, an operation example of the information processing apparatus <NUM> will be described with reference to <FIG>.

In step S101 shown in <FIG>, the user riding in the vehicle activates the voice recognition function. In the present embodiment, the voice recognition function is not always activated. The voice recognition function is activated by means of the user's instruction. An example of an activation method of the voice recognition function will be described with reference to <FIG>. As shown in <FIG>, while the vehicle is travelling, route guidance provided by the navigation device <NUM> is displayed on the touch panel <NUM>. An icon <NUM> indicating speaking is displayed on the touch panel <NUM>. The voice recognition function is activated by the user touching and operating the icon <NUM>. As another activation method, the switches <NUM> provided on the steering wheel may have an activation trigger function, or the voice recognition function may be activated by using the recognition of the user's speech relating to a predetermined keyword as a trigger.

After the voice recognition function is activated, the display on the touch panel <NUM> is switched to the content shown in <FIG>. As shown in <FIG>, after the voice recognition function is activated, the touch panel <NUM> displays an icon <NUM>, an icon <NUM>, and pieces of equipment that can be instructed by means of voice. <FIG> shows an air conditioner, a power window, a navigation device, and an audio device as the pieces of equipment that can be instructed by means of voice, but they are examples.

The icon <NUM> shown in <FIG> indicates that voice recognition is possible. After checking that the icon <NUM> is displayed on the touch panel <NUM>, the user inputs an instruction for actuating the predetermined equipment by using voice. That is, as shown in step S103 of <FIG>, the user inputs voice data to the microphone <NUM>. In <FIG>, the user's instruction is "Open the driver's seat window".

Processing proceeds to step S105, and the voice recognition unit <NUM>, which has acquired the user's voice data, recognizes the voice data. Processing proceeds to step S107, and the voice output unit <NUM> refers to the database <NUM> and acquires feedback voice data corresponding to the recognition result of the voice recognition unit <NUM>. The user's instruction is recognized as "Open the driver's seat window". Therefore, the data "Opening the driver's seat window" is selected as the feedback voice data. The voice output unit <NUM> notifies the user of the feedback voice data by using the speaker <NUM>. When notification of the feedback voice data is started, that is, when the output of the feedback voice data is started from the speaker <NUM>, the display of the touch panel <NUM> is switched to the content shown in <FIG>.

Processing proceeds to step S109, and the notification end determination unit <NUM> determines whether the notification by means of the voice output unit <NUM> has ended. If the notification end determination unit <NUM> receives the end signal after receiving the start signal from the voice output unit <NUM>, the notification end determination unit <NUM> determines that the notification by means of the voice output unit <NUM> has ended. In <FIG>, the end of the notification by means of the voice output unit <NUM> means the end of the output of the voice data "Opening the driver's seat window".

If the notification end determination unit <NUM> has received the start signal from the voice output unit <NUM> but does not receive the end signal thereafter, the notification end determination unit <NUM> determines that the notification by means of the voice output unit <NUM> has not ended. In other words, if the notification end determination unit <NUM> has received the start signal from the voice output unit <NUM> but does not receive the end signal thereafter, the notification end determination unit <NUM> determines that feedback voice data is being notified from the speaker <NUM>.

If the notification end determination unit <NUM> determines that the notification by means of the voice output unit <NUM> has ended (NO in step S109), processing proceeds to step S111. In step S111, the notification end determination unit <NUM> transmits a signal indicating that notification has ended to the control signal transmission unit <NUM>. The control signal transmission unit <NUM> that has received this signal transmits a control signal for opening the window to the power window <NUM> of the driver's seat. Processing proceeds to step S113, and the power window <NUM> having received the control signal automatically opens the window (step S115).

Meanwhile, if the notification end determination unit <NUM> determines that the notification by means of the voice output unit <NUM> has not ended (YES in step S109), processing proceeds to step S119.

In step S119, if the controller <NUM> receives a signal indicating that control is to be stopped from the user during a time period when the feedback voice data is being notified from the speaker <NUM> (YES in step S119), the controller <NUM> stops controlling the predetermined equipment (step S121). The signal indicating that control is to be stopped (hereinafter sometimes simply referred to as a stop signal) will be described. The stop signal is a signal transmitted to the controller <NUM> when the user performs a predetermined operation. When the user gives the instruction "Open the driver's seat window" by using voice, the user receives the feedback "Opening the driver's seat window" via the speaker <NUM>. If there is an error in voice recognition at this time, it is assumed that the user desires to stop the control. In the example shown in <FIG>, the user's voice instruction is correctly recognized. However, it is possible that the user's voice instruction is not correctly recognized, as in the case of "Opening the passenger seat window". In such a case, it is assumed that the user desires to stop the control.

In the present embodiment, during a time period when the feedback voice data is being notified from the speaker <NUM>, the user can transmit a stop signal to the controller <NUM> in a plurality of ways to stop the control by means of the controller <NUM>. Meanwhile, if the notification by means of the voice output unit <NUM> has ended, the user can no longer transmit the stop signal to the controller <NUM>, or even if the user can transmit the stop signal, the controller <NUM> does not accept the stop signal. Therefore, in order to stop the control by means of the controller <NUM>, the user needs to perform a predetermined operation during a time period when the feedback voice data is being notified from the speaker <NUM>. The time period when the feedback voice data is being notified from the speaker <NUM> is defined as a time period from when the notification end determination unit <NUM> receives the start signal from the voice output unit <NUM> to when the notification end determination unit <NUM> receives the end signal.

A description will be given regarding a predetermined operation performed by the user in order to stop the control by means of the controller <NUM> with reference to <FIG>.

As shown in <FIG>, the user can stop the control by means of the controller <NUM> by touching the icon <NUM> displayed on the touch panel <NUM>. Specifically, if the user touches the icon <NUM> during the time period when the feedback voice data is being notified from the speaker <NUM>, the stop signal is transmitted to the controller <NUM>. The controller <NUM> having received the stop signal does not transmit a control signal for opening the window to the power window <NUM>. This stops the control by means of the controller <NUM>. The icon <NUM> is what is referred to as a return icon.

As shown in <FIG>, the user can stop the control by means of the controller <NUM> by touching the icon <NUM> displayed on the touch panel <NUM>. Specifically, if the user touches the icon <NUM> during the time period when the feedback voice data is being notified from the speaker <NUM>, the stop signal is transmitted to the controller <NUM>. The word "Stop" is displayed on the icon <NUM>.

In addition, as shown in <FIG>, the user can stop the control by means of the controller <NUM> by swiping the touch panel <NUM>. The term swiping means an operation of sliding a finger while touching the touch panel <NUM>. If the user swipes the touch panel <NUM> during the time period when the feedback voice data is being notified from the speaker <NUM>, the stop signal is transmitted to the controller <NUM>. In the example shown in <FIG>, the user swipes the touch panel from left to right, but the swiping direction is not limited thereto. The user can also swipe the touch panel down from the top or right to left. Regardless of the swiping direction, if the user swipes the touch panel during the time period when the feedback voice data is being notified from the speaker <NUM>, the stop signal is transmitted to the controller <NUM>.

In addition, as shown in <FIG>, the user can stop the control by means of the controller <NUM> by pressing a specific switch (a switch <NUM> in <FIG>) among the switches <NUM> provided on a steering wheel <NUM>. Specifically, if the user presses the switch <NUM> during the time period when the feedback voice data is being notified from the speaker <NUM>, the stop signal is transmitted to the controller <NUM>. The switch <NUM> is what is referred to as a return switch.

In addition, the user can use voice to stop the control by the controller <NUM>. Specifically, if the user gives an instruction with voice by saying "stop" toward the microphone <NUM> during the time period when the feedback voice data is being notified from the speaker <NUM>, the control by means of the controller <NUM> is stopped. When voice data is input during the time period when the feedback voice data is being notified from the speaker <NUM>, the voice recognition unit <NUM> recognizes the input voice data. If the recognized voice data indicates that the control is to be stopped, the controller <NUM> stops the control. In this case, the voice data input during the time period when the feedback voice data is being notified from the speaker <NUM> serves as the stop signal.

As another example, the user can use a gesture to stop the control by means of the controller <NUM>. Specifically, if the user makes a gesture indicating stop in front of the camera <NUM> during the time period when the feedback voice data is being notified from the speaker <NUM>, the stop signal is transmitted to the controller <NUM>. An example of the gesture indicating stop is a gesture of placing a hand in front of the camera <NUM>. If image data is input from the camera <NUM> during the time period when the feedback voice data is being notified from the speaker <NUM>, the controller <NUM> analyzes the image data. If a gesture indicating stop is detected from the image data, the controller <NUM> stops the control. In this case, the image data input during the time period when the feedback voice data is being notified from the speaker <NUM> serves as the stop signal.

The reason why the user desires to stop the control is not limited to misrecognition of voice data. The user may desire to cancel an instruction, for example. That is, a case is conceivable in which although the user gives an instruction with voice to "Open the driver's seat window", thereafter the user may simply desire to cancel the instruction. In such a case also, as described above, it is sufficient if the user performs a predetermined operation during the time period when the feedback voice data is being notified from the speaker <NUM>.

Returning to <FIG>, in step S117, if the user performs an operation for transmitting the stop signal during the time period when the feedback voice data is being notified from the speaker <NUM>, the stop signal is transmitted to the controller <NUM>. Descriptions of steps S119 and S121 have already been made. The example shown in <FIG> is a case in which the stop signal is transmitted, but it is needless to say that there is also a case in which the stop signal is not transmitted. If the user does not make any action during the time period when the feedback voice data is being notified from the speaker <NUM>, it is needless to say that the stop signal is not transmitted. In this case, the window is opened immediately after the notification has ended.

In step S109 of <FIG>, the end of the notification by means of the voice output unit <NUM> means the end of the notification without transmission of the stop signal from the user during the time period when the feedback voice data is being notified from the speaker <NUM>.

In the above, it has been described that the user can no longer transmit the stop signal to the controller <NUM> when the notification by means of the voice output unit <NUM> has ended, but a supplementary explanation will be given below. When the notification by means of the voice output unit <NUM> has ended, the display on the touch panel <NUM> switches from the content shown in <FIG> to the content shown in <FIG>. Therefore, when the notification by means of the voice output unit <NUM> has ended, the user is not able to transmit the stop signal by using the touch panel <NUM>.

As described above, in accordance with the information processing apparatus <NUM> according to the present embodiment, the following actions and effects can be obtained.

The information processing apparatus <NUM> includes a voice data input device (the microphone <NUM>) to which voice data of a user riding in a vehicle is input, a user data input device (the microphone <NUM>, the touch panel <NUM>, the switches <NUM>, and the camera <NUM>) to which user data is input from the user, and the controller <NUM>. The controller <NUM> recognizes first voice data input to the voice data input device. The first voice data is voice data indicating an instruction for actuating predetermined equipment, and one example thereof is "Open the driver's seat window" described above. The controller <NUM> outputs, from the speaker <NUM>, second voice data indicating that the predetermined equipment is to be controlled based on the recognition result of the first voice data. One example of the second voice data is "Opening the driver's seat window" described above.

After the second voice data is notified, the controller <NUM> controls the predetermined equipment based on the recognition result. Meanwhile, the controller <NUM> stops the control of the predetermined equipment if user data indicating that control of the predetermined equipment is to be stopped is input while the second voice data is being notified. The user data indicating that control is to be stopped is the stop signal described above. According to the information processing apparatus <NUM> having this kind of configuration, control is automatically performed promptly, unless the user transmits a stop instruction after giving feedback to the user. Further, the user can stop the control when necessary.

The predetermined equipment is equipment mounted in a vehicle. The predetermined equipment includes at least any one of the power window <NUM>, the air conditioner <NUM>, the sunroof <NUM>, the sunshade <NUM>, the power back door <NUM>, the power trunk <NUM>, the navigation device <NUM>, and the audio device <NUM>.

The notification given by using the second voice data is a notification indicating that the predetermined equipment will be controlled. As an example, the notification by using the second voice data is a notification indicating that the window of the power window <NUM> will be opened.

If the notification by using the second voice data ends without receiving the user data indicating that control of the predetermined equipment is to be stopped, the controller <NUM> performs the control of the predetermined equipment. In this way, the control is automatically performed promptly unless the user transmits a stop instruction after giving feedback to the user. Further, if the notification by using the second voice data ends without receiving the user data indicating that control of the predetermined equipment is to be stopped, the controller <NUM> performs the control of the predetermined equipment without accepting other user data.

The user data is data indicating that the user has operated the touch panel <NUM>, image data obtained by capturing an image of the user's posture, data indicating that the user has operated the switch <NUM> provided on the steering wheel, or voice data input to the voice data input device.

A time period after the second voice data is notified is defined as a time period after the output of the second voice data ends. A time period during which the second voice data is being notified is defined as a time period from the start to the end of the output of the second voice data.

Next, a modified example of the present embodiment will be described with reference to <FIG>.

An information processing apparatus <NUM> according to a modified example further includes an identification unit <NUM> and a waiting time setting unit <NUM> in comparison with the information processing apparatus <NUM>. The parts that duplicate those of the information processing apparatus <NUM> are denoted by the same reference numerals, and a description of the duplicate parts is omitted. The differences between the information processing apparatuses <NUM> and <NUM> are mainly explained below.

The identification unit <NUM> identifies a usable device for the user among the input devices <NUM>. The usable device here means a device which is usable to stop the control by means of the controller <NUM>. That is, the usable device means a device that is usable during the time period when the feedback voice data is being notified from the speaker <NUM>.

<FIG> shows the microphone <NUM>, the touch panel <NUM>, the switches <NUM>, and the camera <NUM> as the input devices <NUM>. However, not all of the devices are always usable. The devices may not be usable for reasons such as a malfunction. Alternatively, the devices could be unusable due to some restrictions. As a way of identifying whether the devices are usable, it is possible to determine whether there is a signal indicating that the devices are operating normally.

Suppose that the identification unit <NUM> receives a signal indicating that the microphone <NUM>, the touch panel <NUM>, the switches <NUM>, and the camera <NUM> are operating normally. In the above case, the identification unit <NUM> identifies that the devices are usable during the time period when the feedback voice data is being notified from the speaker <NUM>. The identification unit <NUM> transmits a signal indicating an identification result to the waiting time setting unit <NUM>.

The waiting time setting unit <NUM> sets a waiting time based on the signal received from the identification unit <NUM>. The waiting time is the time during which the stop signal from the user is accepted after the notification by means of the voice output unit <NUM> has ended. In the above embodiment, it has been described that the controller <NUM> does not accept the stop signal when the notification by means of the voice output unit <NUM> has ended. However, in the modified example, the stop signal is accepted during the set waiting time even after the notification by means of the voice output unit <NUM> has ended. Suppose that the notification by means of the voice output unit <NUM> is <NUM> seconds and the waiting time set by means of the waiting time setting unit <NUM> is <NUM> seconds, for example. In the above case, in the modified example, the time during which the user can transmit the stop signal is <NUM> seconds (<NUM> seconds + <NUM> seconds).

Next, a description will be given regarding how to set the waiting time. The waiting time is set depending on a usable device identified by means of the identification unit <NUM>. Suppose that the only device identified as usable is the camera <NUM>, for example. In this case, the waiting time is set to be the longest compared to when other devices are identified. The reason why the waiting time is set to be the longest is because the user has to place a hand in front of the camera <NUM> in order to transmit the stop signal, and the time required for this operation needs to be ensured. This waiting time is referred to as a first waiting time.

Subsequently, suppose that the only device identified as usable is the microphone <NUM>. In this case, the waiting time is set to be shorter compared to when the camera <NUM> is identified. This is because the time required for speaking is shorter compared to the operation of placing a hand in front of the camera <NUM>. This waiting time is referred to as a second waiting time.

Subsequently, suppose that the only device identified as usable is the touch panel <NUM>. In this case, the waiting time is set to be shorter compared to when the camera <NUM> is identified. This is because the time required for the operation of the touch panel <NUM> is shorter compared to the operation of placing a hand in front of the camera <NUM>. This waiting time is referred to as a third waiting time.

Subsequently, suppose that the only device identified as usable is a switch <NUM> (the switch <NUM>). In this case, the waiting time is set to be shorter compared to when the camera <NUM> is identified. This is because the time required for the operation of the switch <NUM> is shorter compared to the operation of placing a hand in front of the camera <NUM>. This waiting time is called a fourth waiting time.

The relationship among the first to fourth waiting times is as follows: the first waiting time > the second waiting time > the third waiting time > the fourth waiting time.

Next, an operation example of the information processing apparatus <NUM> will be described with reference to <FIG> and <FIG>. However, since processing in steps S201 to S205, S211, and S215 to S225 is similar to the processing in steps S101 to S105, S107, and S111 to S121 shown in <FIG>, the description thereof is omitted.

In step S207, the identification unit <NUM> receives, from the microphone <NUM>, the touch panel <NUM>, the switches <NUM>, and the camera <NUM>, signals indicating that the devices are operating normally. After receiving the signals, the identification unit <NUM> identifies that the devices are usable. The identification unit <NUM> transmits a signal indicating the identification result to the waiting time setting unit <NUM>.

In step S209, the waiting time setting unit <NUM> sets the waiting time based on the signal received from the identification unit <NUM>.

In step S213, the notification end determination unit <NUM> determines whether the waiting time has ended. If the notification end determination unit <NUM> receives a signal indicating that the waiting time has ended from the waiting time setting unit <NUM> after receiving the start signal from the voice output unit <NUM>, the notification end determination unit <NUM> determines that the waiting time has ended. As an example, suppose that the notification by means of the voice output unit <NUM> is <NUM> seconds and the waiting time set by means of the waiting time setting unit <NUM> is <NUM> seconds. In the above case, the notification end determination unit <NUM> determines that the waiting time has ended at a time point <NUM> seconds after the start of the notification by means of the voice output unit <NUM>. The end of the waiting time in step S213 means that the waiting time has ended without transmission of the stop signal from the user.

The user data includes a plurality of types. Specifically, equipment capable of transmitting the stop signal includes a plurality of types (the microphone <NUM>, the touch panel <NUM>, the switches <NUM>, and the camera <NUM>). The controller <NUM> changes the time (the waiting time) during which the user data indicating that control of the predetermined equipment is to be stopped is accepted depending on the types of user data. According to the information processing apparatus <NUM> having this kind of configuration, unless the user transmits a stop instruction after giving feedback to the user, the information processing apparatus <NUM> performs the control quickly and automatically after the waiting time has elapsed. In addition, the types of user data are used to set the waiting time, and therefore it becomes possible to have settings that are suitable for the user interface.

It has been described that the waiting time is set depending on a usable device identified by means of the identification unit <NUM>, but the waiting time is not limited thereto. The waiting time may be set depending on equipment corresponding to the user's instruction. If the user's instruction is "Open the driver's seat window" as described above, the equipment corresponding to the user's instruction is the power window <NUM>. In another example, if the user's instruction is "Play the radio", the equipment corresponding to the user's instruction is the audio device <NUM>. If the equipment corresponding to the user's instruction is equipment in which entrapment may occur, such as the power window <NUM>, the sunroof <NUM>, the power back door <NUM>, or the power trunk <NUM>, the waiting time thereof may be set to be longer compared to the waiting time of equipment in which entrapment does not occur. This allows the user to ensure the time used for determining whether to stop the instruction.

In addition, if equipment corresponding to the user's instruction is equipment that performs travel control such as automated driving, the waiting time of the equipment may be set to be longer than the waiting time of equipment that does not perform travel control. This is because, since the travel environment changes from time to time, time may be required for determining whether to stop an instruction regarding the travel control.

Further, the waiting time may be set depending on whether a vehicle is travelling or stopped. Specifically, if the vehicle is travelling, the waiting time may be set to be longer compared to when the vehicle is stopped. This is because it is expected that the user's response will be more delayed when the vehicle is travelling compared to when the vehicle is stopped.

Each function described in the above embodiment may be implemented by means of one or more processing circuits. The processing circuits include a programmed processing device such as a processing device including an electronic circuit. The processing circuits also include devices such as application specific integrated circuits (ASIC) and circuit components that are arranged to perform the described functions.

Although an embodiment of the invention has been described as described above, the discussion and drawings forming part of this disclosure should not be construed as limiting the invention. Various alternative embodiments, examples, and operational techniques will be apparent to those skilled in the art from this disclosure.

There is a case where a signal different from the stop signal is input from the user during the time period when the feedback voice data is being notified from the speaker <NUM>, for example. The controller <NUM> may have a function of determining whether the signal input during the time period when the feedback voice data is being notified from the speaker <NUM> is the stop signal.

The controller <NUM> may accept user data indicating that control of the predetermined equipment is to be stopped only if the predetermined equipment is a device that operates mechanically or is a device that controls the in-vehicle environment. A device that operates mechanically is the power window <NUM>, the sunroof <NUM>, the power back door <NUM>, or the power trunk <NUM>. A device that controls the in-vehicle environment is the air conditioner <NUM>. This allows the user to stop the control of the equipment in which entrapment may occur due to the equipment being activated and equipment that affects driving.

Navigation devices in recent years have many functions in addition to route guidance. Examples of the functions include provision of weather information, provision of news, and the like. Therefore, user's instructions that are input to the microphone <NUM> include instructions for requesting weather information, news, and the like.

The controller <NUM> does not need to accept the stop signal for instructions requesting weather information and news. This is because the provision of weather information and news does not include a mechanical operation or an operation that affects driving.

Claim 1:
An information processing apparatus (<NUM>) comprising:
a voice data input device (<NUM>) to which voice data is input;
a controller (<NUM>) configured to recognize an instruction for actuating a predetermined equipment mounted in a vehicle, the instruction being contained in first voice data input to the voice data input device (<NUM>); and
a user data input device (<NUM>) to which user data indicating that control of the predetermined equipment is to be stopped is input from a user and which is capable of transmitting a stop signal to the controller (<NUM>), the stop signal indicating that control of the predetermined equipment is to be stopped;
wherein the controller (<NUM>) is configured to:
output a notification of second voice data indicating that the predetermined equipment is to be controlled based on a recognition result of the instruction in the first voice data;
set a waiting time during which the stop signal is accepted after the notification of the second voice data has ended, depending on the predetermined equipment indicated in the first voice data; and
control the predetermined equipment based on the recognition result after the second voice data is notified and the waiting time has ended without receiving the stop signal, but stops controlling the predetermined equipment if the stop signal is received during a time period when the second voice data is being notified or during the waiting time,
wherein, if the predetermined equipment is an equipment in which entrapment may occur or an equipment that performs vehicle travel control such as automated driving, the waiting time thereof is set to be longer compared to the waiting time of an equipment in which entrapment does not occur or an equipment that does not perform vehicle travel control, and
wherein the equipment in which entrapment may occur includes at least any one of a power window (<NUM>), a sunroof (<NUM>), a power back door (<NUM>) and a power trunk (<NUM>).