Speech dialogue system for dialogue interruption and continuation control

A speech dialogue system (SDS) is provided for carrying out a speech dialogue with a user to control an electronic device. The SDS includes a speech dialogue interruption unit for interrupting the speech dialogue and a speech dialogue continuation unit for continuing the interrupted speech dialogue. The system provides a method of conducting the speech dialogue between the speech dialogue system and a user. The method provides the steps of interrupting the speech dialogue upon receipt of a predetermined pause command from the user or from an electronic device. The method continues the speech dialogue with the speech dialogue system when the user or the electronic device provides a predetermined continuation command to the SDS. The method further allows the canceling of the speech dialogue when the user provides a predetermined cancellation command to the SDS.

PRIORITY CLAIM

This application claims the benefit under 35 U.S.C. § 119(a)-(d) to European Patent Application No. 04001949.9 filed on Jan. 29, 2004. The disclosure of the above application is incorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION

1. Technical Field

This application relates to a system for carrying out a speech dialogue between a speech dialogue system and a user, and in particular, a system for carrying out a speech dialogue between a speech dialogue system and a user where the user uses the speech dialogue with the speech dialogue system to control an electronic device. The system furthers provides a method for carrying out a speech dialogue between a speech dialogue system and a user.

2. Related Art

Speech dialogue systems (“SDS”) represent voice interfaces between a human user and a machine or electronic device, whereby the user can control the machine by giving speech commands to the SDS. The SDS analyzes the speech commands and filters out control commands that in turn are transmitted to the machine or the electronic device. A speech dialogue carried out between the SDS and a user may include the steps of transmitting a request for an acoustic or voice input by the SDS, waiting for a speech input from the user, and receiving a speech input from the user. To carry out a full speech dialogue, these steps may be repeated as necessary to provide the information for controlling the machine or electronic device. In one example, an SDS may be located in a car where the SDS offers the user the possibility to control at least some of the electronic devices in the vehicle without the driver diverting his or her attention from traffic. Such devices may include the vehicle's radio, its navigation system, or its climate control system.

The method for communicating with an SDS may begin with the user orally requesting a speech dialogue. Following the request, the SDS may prompt the user and wait for an input. If the user delays replying to the SDS, because the user is otherwise occupied with traffic, then the SDS may shut down the dialogue after a predetermined delay. Where the user has already communicated some information, the information may be lost and the user will have to start the application over from the beginning. Therefore, a need exists for a system that preserves the previously communicated instructions and resumes the dialogue without starting from the beginning.

SUMMARY

This application provides a speech dialogue system (“SDS”) that carries out a speech dialogue between the SDS and a user where the SDS controls an electronic device with the voice commands received from the user. The system provides a method for carrying out a speech dialogue between the SDS and a user where the SDS controls an electronic device with the voice commands received from the user. The system may include a speech dialogue interrupting unit that interrupts an ongoing speech dialogue between a user and the system. The system also may include a speech dialogue continuing unit for continuing the interrupted speech dialogue at a point where the speech dialogue was interrupted. The system also may include a cancellation unit for canceling the interrupted speech dialogue upon the user's request. The system may be configured for receiving the commands for interrupting and continuing the speech dialogue by receiving the pause and continue commands through a microphone or by the use of control keys.

The system further provides a method that may include the steps of interrupting the speech dialogue upon receipt of a predetermined pause command by the SDS and continuing the speech dialogue upon receipt of a predetermined continuation command. The method may provide a step for canceling the speech dialogue upon receipt of a predetermined cancellation command by the SDS. The cancellation command may be a speech command or the command may be transmitted by the user activating a control key or switch.

The method may include a step where an electronic device issues a pause or interruption command. When the electronic device is finished with an operation that requires the interruption, the electronic device may issue a continuation command to resume the speech dialogue. Thus, the speech dialogue will proceed from the point where the speech dialogue was interrupted. For example, an electronic device that issues an interruption command may include a telephone that interrupts the speech dialogue when an incoming call is received.

The system may be configured to continue an interrupted speech dialogue when the user repeats part of the speech dialogue or repeats the last step. The system may include a memory unit that stores the previously received commands from the user. The method may provide the opportunity to request and conduct a second speech dialogue that controls a second electronic device. Upon completion of the second speech dialogue, the user may continue with the first dialogue at the point where the user previously interrupted the speech dialogue without having to start at the beginning. The memory allows the system to retain or store the previous instructions or commands. Further, the system may provide the flexibility to repeat the speech dialogue by repeating the last step of the previously interrupted speech dialogue and continuing the speech dialogue at that point.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

This application provides a Speech Dialogue System (SDS) that may interrupt an ongoing speech dialogue between a user and the SDS when the user becomes otherwise distracted with another task and permit resumption of the speech dialogue at the point where the dialogue was interrupted at a later time. The SDS may interface with an electronic device or machine converting the voice or speech instructions to commands for controlling the electronic device or machine. The SDS may interface with more than one electronic device or machine such as those found in a vehicle.

FIG. 1shows an interior of a vehicle that includes an information and entertainment system1. The information and entertainment system may include several electronic devices such as a radio device3that may include a compact disk (CD) player5, digital versatile disk (DVD) player9and compact cassette (CC) player (not shown). The vehicle also may include a navigation system7and a climate control system (not shown). A telephone may be included where the telephone is fixed to the vehicle (not shown), or as a mobile telephone11held by a mobile telephone holder13. An on-board computer15, a super audio compact disk player (not shown), and an MPEG audio device (not shown) also may be included. Other devices, such as a television, an internet connecting device, or a computer game console may be a part of the information and entertainment system for the vehicle. Such an SDS18may be implemented in a household system as well.

The information and entertainment system1may include a head unit17which includes the SDS18. The head unit17connects to the electronic devices and may transmit control commands to the devices. The head unit17also may receive commands from those electronic devices. The SDS18includes an input means such as a microphone19. The microphone may be provided at different locations or at several different locations throughout the vehicle. For example, the microphone19may be located in the vicinity of each passenger location. As shown inFIG. 1, the microphone18which may be arranged in the rear view mirror21.

The SDS18may include control keys23which may be located on the steering wheel25and control keys27located on the multimedia screen29. The multimedia screen29may be part of the information and entertainment system17and the screen29may serve as an output or output means for the SDS18. The multimedia screen29also may be an output for the electronic device that is being controlled. Another output means may include loudspeakers31for the electronic devices and SDS18. The electronic devices may be controlled by control keys33,35,37and39that control the navigation system7, the radio3and CD player device5, the climate control system9, and the mobile telephone or telephone11, respectively.

The SDS may conduct a speech dialogue with a user for controlling the electronic device50or devices. The SDS may be configured to interrupt a speech dialogue at any time with an audible command or by activating a pause key. The speech may be continued by an audible command or by the activation of a continuation key.

The information and entertainment system1may include a head unit17which includes the SDS18. The head unit17connects to the electronic devices and may transmit control commands to the devices. The head unit17also may receive commands from those electronic devices. The SDS18includes an input means such as a microphone19. The microphone may be provided at different locations or at several different locations throughout the vehicle. For example, the microphone19may be located in the vicinity of each passenger location. As shown inFIG. 1, the microphone19which may be arranged in the rear view mirror21.

The speech analyzing unit40may be connected to a microphone18and to the speech dialogue unit42. The speech analyzing unit40also may be connected to the interruption unit44and to the continuation unit46. The speech dialogue unit42may be connected to the interruption unit44, the continuation unit46, and the cancellation unit47. The speech dialogue unit may have a push to talk (“PTT”) lever48which serves to switch the SDS18on or off. The speech dialogue unit also may connect to an output means29and31and electronic devices50and54. The speech dialogue unit42may include a memory unit58for storing the interrupted speech dialogue. The memory unit58may be a semiconductor memory, magnetic storage unit or even an optical storage unit. The output means of the SDS18may include a speaker31and a multimedia screen29. An interruption control key52may connect to the interruption unit44. A continuation control key56may connect to the continuation unit46. A cancellation control key or switch may connect to the cancellation unit47.

In the example ofFIG. 2, the speech analyzing unit40analyzes the sound data received by the microphone19. The analyzing unit40may remove background noise and filter out and separate the speech inputs. The speech dialogue unit42may receive speech inputs from the speech analyzing unit40. The speech inputs may be analyzed and identified as control commands. The control commands may be transmitted to the electronic device50, directly from the SDS18or via the head unit17(not shown inFIG. 2). Prompts or requests from the SDS18for speech input from the user may be output by the speech dialogue unit42to the user through the loudspeaker31or the multimedia screen29. The loudspeakers may be the audio speakers in a car that are connected to a sound system that includes the radio3and CD player5.

The speech dialogue interruption unit44may connect to the speech analyzing unit40, a pause control key52, and an electronic device54. The interruption unit44may be a controller or other logical circuit unit that issues an interrupt when a pause command is recognized by the speech analyzing unit40, when a signal is received from the pause control key52, or when an interrupt is received from the electronic device54. The interruption unit44may transmit a pause or interrupt signal interrupting the speech dialogue unit42which interrupts the speech dialogue. Thus, the speech dialogue can be interrupted by the user or by another electronic device such as a telephone11. For example, an incoming call to a telephone11may cause the telephone11to issue a pause command to interrupt the speech dialogue and possibly an ongoing operation of the entertainment system1. When the telephone11pauses the interruption unit44, the interruption unit44signals the speech dialogue unit42with an interruption signal. The speech dialogue unit42may then pause until further instructions are received from the user or the telephone11.

When the speech dialogue unit42is interrupted, the speech dialogue unit42may be configured to identify the electronic device50for which the speech dialogue was interrupted. The identification of the electronic device50may be displayed on the multimedia screen29. Further, the multimedia screen29may display the received speech dialogue from the user so that the user may resume at the point where the speech dialogue was interrupted. By looking at the multimedia screen29the user can continue at that point. If more than one speech dialogue was interrupted, the display may indicate each electronic device50and the point where each speech dialogue was interrupted. The user may select the electronic device50and54from the multimedia screen29to continue the corresponding speech dialogue.

The speech dialogue continuation unit46may be connected to the speech analyzing unit40, a continuation control key56, and an electronic device50or devices. The continuation unit46may be a logic circuit or controller that issues a continuation signal to the speech dialogue unit42, alerting the speech dialogue unit42to resume and continue with the speech dialogue that was interrupted. The continuation unit42may be configured to receive an audible continue command from the user. Alternatively, the user may activate the continuation control key56to continue the speech dialogue. Further, an electronic device54may request a continuation of the speech dialogue. A telephone call may have initially interrupted the speech dialogue and upon completion of the telephone call, the telephone11sends the continuation command to the continuation unit46. The continue signal from the continuation unit46allows the speech dialogue unit42to continue with the speech dialogue from the point where the dialogue was paused.

The interrupted speech dialogue cancellation unit47may be connected to a cancel control key57or switch and the speech analyzing unit40. The cancellation unit47may transmit a cancellation signal to the speech dialogue unit42canceling the interrupted dialogue. The cancellation command may cancel a chosen speech dialogue at any time. The cancellation command may originate with the user, either audibly or by activating the cancellation control key57. This command gives the user an option to discontinue the speech dialogue. The cancellation signal from the cancellation unit47may reset the speech dialogue unit42.

A single control key may incorporate the functions of the pause control key52and the continuation control key56. Where one control key is provided, the key may be configured so that upon a first activation the speech dialogue is interrupted and upon a second activation the interrupted speech dialogue is continued. In another example, the control key may be a “push to talk” (PTT) lever, used to switch the SDS18on and off. The PTT lever also may be configured as an interruption and continuation key. Depending on the way the PTT lever is activated, either the SDS18is turned off or the dialogue is simply interrupted and continued. For example, if the PTT lever is held for a relatively long period of time, the SDS18may be turned off On the other hand, when the PTT lever is held for a short time period, it is a signal to interrupt and pause the dialog or continue the dialogue if the dialogue was already paused.

A single control key also may incorporate the functions of the four control keys48,52,56and57shown inFIG. 2. The operation of one control key may depend on the way the key is activated. Either an ON/OFF function, the pause/continue function, or the cancellation may be carried out by the control. In addition to the control keys48,52,56and57inFIG. 2, control keys from the electronic devices3,5,7,9,11,13, and15shown inFIG. 1may fulfill the role of the pause control key and the continuation control key. For example, the pause key for the CD player5may be utilized as a pause and continuation control key for the speech dialogue. Further, the control keys may be located in the steering wheel providing easy access for the driver.

As shown inFIG. 2, the SDS18is controlling only one electronic device46. However in combination withFIG. 1, it is understood that the SDS18can be used to control more than one electronic device (in combination with the head unit17) and more than one electronic device50may provide pause and continuation commands. The interruption unit44and the continuation unit46may be configured in conjunction with the speech dialogue unit to interrupt any of the various electronic devices50. The user may interrupt a speech dialogue with one electronic device50and begin a dialogue with a second or third device. An electronic device54may also interrupt an on-going speech dialogue with another device50. As mentioned previously, the electronic device54might be a telephone11that interrupts a speech dialogue with the electronic device50upon receiving an incoming phone call.

The SDS18also may be configured to allow a particular electronic device50to either interrupt or continue operating even if a speech dialogue is interrupted. For instance, where an incoming phone call is present, the user may configure the radio3to continue playing. Also, the user may configure the system to mute or interrupt the radio3or another entertainment device at the time of an incoming phone call.

The SDS18may be configured to interrupt the speech dialogue when a pause command is received by the interruption unit44from an electronic device54. When the continuation unit46receives a continuation command from the electronic device54the speech dialogue is continued. By way of example, the user could conduct a speech dialogue to control and input a new target address into the navigation system7. During this speech dialogue, the telephone11receives an incoming call and provides an interruption command to the interruption unit44to interrupt the speech dialogue, informing the user about the incoming telephone call. Once the telephone call is finished the telephone11may then provide the continuation command to the continuation unit46so that the interrupted speech dialogue can be continued. In this example, the user may finish the speech dialogue with the navigation system7by inputting the remainder of the instructions.

In another example, if an electronic device50is already operating and the user is performing a speech dialogue to change the operation of that electronic device50, and for some reason, the user needs to interrupt the speech dialogue, or another electronic device54should interrupt the dialogue, the device50may continue to operate. For instance, the CD player5is playing a CD. The user would like to select another CD for the CD player5to play. The user begins the speech dialogue but interrupts the speech dialogue before informing the CD player5which CD to select. The CD player5may continue playing the current CD.

In a variant of the above example of exchanging one CD with another CD, the user decides to interrupt the dialogue after instructing the SDS18that he wants to switch CDs. However, before the user identifies the new CD, the interruption occurs. The SDS18may continue the operation and provide a control command to the CD player5to remove the current CD from the player and place it in the magazine and wait for the command associated with the new CD. Once the user decides to continue with the speech dialogue and instructs the system to play the desired CD, the waiting time for the selection of the new CD is reduced in comparison to a system without the interruption and continue feature.

In a further example, a computer system15, a navigation system7, or an MP3 player (not shown) may download information during the interruption of the speech dialogue. The electronic device50associated with the speech dialogue can continue downloading the information from a remote location during the interruption of the speech dialogue, reducing the download time for the user. When the speech dialogue continues the information may be readily available in the device when needed.

For example, during the interruption of the speech dialogue, the SDS18may transmit control commands to the electronic device so that the electronic device50continues operating when no further instructions are necessary. The user may input a new target location into the navigation system7to obtain navigation information. However, the speech dialogue is interrupted after the user announces the destination city but does not announce the street information. The navigation system7may calculate the best route to the city during the speech dialogue interruption with the navigation system7anyway. The navigation system7may be configured to download corresponding maps that depend on the current location of the user and the user's final destination from a remote server. From that information only, the server may be able to determine the location of the final destination and present the user with the results without further commands from the user.

The SDS18may be configured so that a second speech dialogue is performed while a first speech dialogue is interrupted. The second speech dialogue may control a different electronic device. In the previous example, where the inputting of a new target location into the navigation system7is interrupted by an incoming telephone call, the user during the telephone conversation may store a new address or telephone number into his telephone11. This feature allows the storage of the new address or telephone number via the SDS18, even while the first speech dialogue with another electronic device50, such as the navigation system7is interrupted.

The multimedia screen29for the SDS18may include a touch screen (not shown). When the SDS18is configured, the touch screen for the multimedia screen29may be used to interrupt and continue the speech dialogue with any of the electronic devices50for which the SDS18controls. The SDS18may be configured for displaying the identification of an interrupted speech dialogue and the electronic device50for which the interruption corresponds. In addition, the SDS18may be configured so that touching the appropriate portion of the touch screen29may include a command to cancel the interrupted speech dialogue. At least three roles may be fulfilled with such a touch screen. For example, one role may inform the user about the status of the ongoing speech dialogues with any of the associated electronic devices50. Another role may give the user the possibility to interrupt, continue or cancel any of the possible interrupted speech dialogues for the associated electronic devices50. Further, the touch screen may also be a display for the electronic devices50, such as the navigation system7, the DVD player or even the on-board computer15.

The SDS18may include a third control key (not shown) that is configured such that each interrupted speech dialogue is attributed to a different third control key. Upon activation of a second control key, the corresponding speech dialogue may be continued. In combination with the multimedia screen29showing all of the interrupted and ongoing speech dialogues, the third control key may provide an easy way for the user to continue with the desired speech dialogue.

A memory unit58or a storage means, such as a solid state memory, may be provided for storing the speech inputs from the user. The continuation unit46can be configured to replay part of the interrupted speech dialogue for the user so the user knows where the speech dialogue was interrupted. Upon continuing, the user will be able to realize where the speech dialogue was interrupted. The memory unit58may provide storage for several ongoing speech dialogues with one or more electronic devices50. The user will have the flexibility of multi-tasking with several electronic devices at one time. This will be especially advantageous if the user is trying to operate a CD player5and the navigation system7at the same time and receives a phone call in the middle of a speech dialogue.

FIG. 3illustrates a method for carrying out a speech dialogue between an SDS18and a user in order to control an electronic device50. The process may be carried out by the SDS18ofFIG. 2or by the information and entertainment system as described inFIG. 1. Initially, the SDS18determines whether a request for a speech dialogue has been given by the user (step60). To make a request, the user may activate the push to talk lever48. Once the user has made a request, the SDS18requests a speech input from the user (step62). The speech dialogue unit42may wait for a speech input or instruction from the user. In the meantime, the SDS18determines whether a speech input has been received (step64) by the speech dialogue unit42. When the speech input has been received, the SDS18checks whether the provided speech input corresponds to a pause command or contains a control command for controlling the electronic device50(step66).

When the speech input does contain a pause command, the dialogue will be interrupted and the SDS18will pause at the last completed step for the electronic device50. The pause command may take effect as soon as the command is given or a short time thereafter. The process may continue when a continue command is received (step68). Again, the continue command may take effect as soon as the command is given or a short time thereafter. During the period of interruption of the dialogue, the multimedia screen29may display an identifier for the interrupted speech dialogue which may indicate the electronic device50that is targeted. During the interruption, it may be possible (not shown inFIG. 3) to start a second speech dialogue to control a different electronic device50. The method for conducting the second speech dialogue would be identical to the method steps inFIG. 3.

The user may interrupt the speech dialogue for many reasons including the task of conducting the speech dialogue is too distracting because the user is driving a motor vehicle. For instance, traffic became dense and the driver must pay closer attention to the traffic. The user may give a speech command such as “pause” or activate a pause control key52on the speech dialogue system18to interrupt the dialogue. Continuing with the interrupted speech dialogue may be as simple as saying “continue” or activating a continuation control key56on the SDS18.

However, during the speech dialogue, the user may not provide an interruption command. The on-going speech dialogue may be interrupted by a second electronic device54through the SDS18. A second speech dialogue with the second electronic device54may be requested while the first speech dialogue remains interrupted. For example, the speech dialogue for communicating data for a target location into a navigation system may be interrupted by a telephone11. During the telephone conversation, the user may need to store a new address or telephone number into his telephone. A request to the SDS18may be made and the second speech dialogue may take place for storing the address or phone number in the telephone11, even though the first speech dialogue remains interrupted.

When a command has been received (step68) during the speech dialogue interruption, the process determines (step69) whether the command is a continuation command or a cancellation command. The speech analyzing unit40may analyze the signals received from the microphone19to filter out continuation and cancellation commands from the user. If the command is a cancellation command, the SDS18will end the interrupted speech dialogue. The SDS18may output a message informing the user that the dialogue has been cancelled.

When the continuation command is received (step69), the SDS18outputs information regarding the interruption point of the speech dialogue (step70). The continuation command may be an activation of the continuation key56(which may be combined with the PTT lever48, as described above) or a speech command. The continuing command may be received from an electronic device54that may have interrupted the speech dialogue. The term “continuing” means that the speech dialogue is not restarted at the beginning. The previously provided speech from the user is still available to the user in the SDS18and may be stored in an internal storage means58.

The continuation or continuing command may be include a repeating of part of the speech dialogue that was already communicated to the SDS18(step70). The speech dialogue also may be continued exactly at the position where it was previously interrupted. By repeating a part of the speech dialogue, the user may receive information from the SDS18concerning the user inputs prior to the interruption (step70). The SDS18may provide the information on a multimedia display29or through the speaker31(step70).

The SDS18may otherwise provide the user with information concerning the speech dialogue to be continued when the user activates the continuation control key56. For example, the SDS18may output, acoustically and/or visually, an identifier for the interrupted speech dialogue (step70). The SDS18may repeat the last command received from the user which may have been carried out prior to the interruption. Alternatively, the SDS18may repeat all of the speech inputs received from the user and then repeat the last request from the SDS18(step70). The SDS18, after repeating all of the speech inputs may proceed to the next request (step62). In a further example, the user may request from the SDS18, the last commands or information that the user previously transmitted to the SDS18.

The process may continue with the last request from the SDS18. This is the last request for which information was not received from the user because of the interruption. Therefore, the SDS18may resume the speech dialogue by repeating the last request (step62). The wording for the request from the SDS18may vary from the first time this information was requested to alert the user that this is a continued speech dialogue. The step for continuing with the speech dialogue may include notifying the user that the speech dialogue is about to begin (step70). This notification can be through the speaker31or the multimedia screen29.

When there is more than one speech dialogue that has been interrupted the step of continuing one of the interrupted speech dialogues (step69) may include notifying the user of the continued speech dialogue, in particular, by identifying the electronic device50that will be controlled by the speech dialogue (step70). The identification may be the announcement of the name of the electronic device50that will be controlled by the speech dialogue. The SDS18may display the name of the electronic devices50that are interrupted on a multimedia screen29(step70). The SDS18may be connected to the screen29or the screen29may be an integral part of the SDS18. During an interruption of the speech dialogue, the screen29may be used to keep the user informed of which speech dialogues are currently interrupted.

The process may continue with the wait cycle for the input (step64) and when the information is received, the information will be screened for an interrupt command (step66) once again. If the command received from the speech analyzer40is not an interrupt command, then the command received will be transmitted (step72) to the electronic device50as a control command. This transmission may be directly to the electronic device50or through the head unit17. The control command is then carried out by the electronic device50. The SDS18will then check to see if there is any more information that is required or whether the end of the speech dialogue has been completed (step74). If more information is required, then the SDS18will make a request of the user (step62) for the next item of information that is needed to adequately control the electronic device50. The speech dialogue process (steps62through74) will continue until all of the information that is needed to control the electronic device50is acquired.

In the above description, the pause or interrupt command was a speech command. The pause command could have been indicated by a pause key52. The use of the pause key52may allow the process to be interrupted at any time. As described previously, the speech dialogue also may be interrupted when a pause command is received by the interruption unit44from one of the electronic devices54. The process also may continue when a continuation command is received at the continuation unit46from one of the electronic devices.

FIG. 4is an example of the information that may be displayed on the multimedia screen29during an interruption of a speech dialogue. InFIG. 4, the screen29displays two interrupted dialogues, one associated with a telephone call83and another concerning the navigation system84. Each interrupted speech dialogue83and84may correspond to a control key80and82which are part of the control keys27(fromFIG. 1). When the control key80is pressed, the interrupted speech dialogue associated with the telephone call may continue. When the control key82is pressed, the interrupted speech dialogue associated with the navigation system7may continue.

FIG. 4shows a placement of the four control keys, the PTT key48, the interrupt or pause key52, the continue key56, and the cancel key57. These keys48,52,56, and57were previously described with respect to the description ofFIG. 2. The placement of these keys48,52,56, and57may be on the housing for the multimedia screen29for the convenience of operation.

Upon implementing the speech dialogue, the SDS18may use pre-programmed queries that will be presented to the user. The speech dialogue may be present on the multimedia screen as well as by sound through the speaker31. Example 1 presents a scenario of a speech dialogue that may take place while placing a telephone call.

Column1represents the speech input from the user and column2represents a programmed query from the SDS18. After having input the area code (step102) the user requests an interrupt to the dialogue (step104) by saying “pause.” Rather than saying “pause,” the user may issue a haptic pause with the pause control key56or by a touch screen on the multimedia screen29. The speech dialogue may continue after the user has provided the continuation command (step106). After continuing, (step107) the SDS18informs the user which speech dialogue was interrupted and repeats (step108) the last input given by the user. The user may continue reciting the rest of the telephone number for the SDS18. The SDS18repeats the number to be dialed (step111) and may transmit the corresponding control commands, i.e. the telephone number to the telephone for dialing. In this particular speech dialogue, the SDS18repeats the speech input given from the user (steps103and110).

user (voice entry)SDS (voice output)200telephone call201please provide number20201732030173 and then?204pause205speech dialogue frozen206radio control207radio control on208volume down by two points209volume down by two points210continue and repeat last input211dial telephone number2120173 and then?21339942143994215the number 01733994 will bedialed

In Example 2, steps200-205and steps211-215correspond to the first example and will not be explained in detail. The overall difference between the two examples is that the user starts a second speech dialogue while the first speech dialogue is interrupted. The user makes a request to carry out a speech dialogue with the radio (step206). After the request for the second speech dialogue is granted, the user requests a change in volume (step208). The radio carries out the command (step209) and the second speech dialogue terminates. The user may request a continuation of the first interrupted speech dialogue associated with the telephone call (step210). The user requests the SDS18to provide the necessary information so that the user knows where the first speech dialogue was interrupted. The SDS18responds with the function (step211) and then repeats the last request (step212) made by the SDS18.

In example 3, the user carries out a speech dialogue to change the radio station. The user requests radio control (step300). Once the SDS18responds with an acknowledgement (step301), the user states the command of “change radio station” (step302). The SDS18requests the radio station (step303) and the speech dialogue is interrupted by an incoming telephone call (step304). Upon receiving the incoming telephone call the telephone sends a pause command to the SDS18which in turn interrupts the speech dialogue (step305). As soon as the telephone call is terminated the telephone sends a continuation command to the SDS (step306) and the speech dialogue continues (steps307-309). An additional step may be added (step305) where the SDS18informs the user that the speech dialogue will be interrupted due to the telephone call. During the interruption of the dialogue, the SDS18may transmit a control command to the radio interrupting the operation of the radio so that the telephone call will not be disturbed by the background noise of the radio. During the interruption of the dialogue, the SDS18may transmit a control command to the head unit that interrupts the operation of the head unit so that the telephone call will not be disturbed by the background noise or the operation of the head unit.

Example 4 describes a speech dialogue between a user and a SDS18where the SDS18has a speaker31and a multimedia display29output. In this example, the user will input a new target destination into a navigation system7. The user enters the first letters of the target location (step402). In response, the SDS18announces that the navigation system7has found several locations comprising these letters (step403) and the locations are displayed on the multimedia screen29connected to the SDS18. The user may be informed that the locations may be selected by announcing the corresponding number that is displayed on the screen (step404) with the location. However, the speech dialogue is then interrupted due to a corresponding spoken pause command from the user (step405). During the interruption, the multimedia screen29may display the fact that the navigation speech dialogue has been interrupted (step406). Following the continuation command (step407) from the user, the SDS18repeats the last request for speech input (step408) and the screen displays the same choices associated with the locations (step409). The user then chooses one of these locations (step410) and the new target location can be input into the navigation system (step411).

In a variation of this example, the navigation system may generate the navigation information for each of the three possible locations during the interruption of the speech dialogue. When the speech dialogue is continued and the user makes a selection, the navigation system immediately proposes the corresponding navigation information for the destination which may speed up the application for the user.

A speech dialogue may be divided into several logical units. For example, the user may want to input a location into a navigation system. The SDS18may request logical units of the address requesting first, the city, and second, the street and street number. When continuing the speech dialogue after an interruption the speech dialogue may continue with one of the logical units depending on where the interruption occurred. If the street name has already been given, but not the number, the speech dialogue may continue by requesting the user to repeat the name of the street. By repeating a part of the speech dialogue, it is easier for the user to continue with the input as the user does not have to remember all of the details that were previously entered.

Although, the examples are described with reference to use in a vehicle, in particular a car, with an SDS18as described, the system is not restricted to cars but may be provide in any vehicle, such as a truck, bus, mobile home, or boat. Further, the system may be used in a home entertainment system that is especially conducive to receiving voice commands or other control systems in a home for controlling lights, environment, security systems and telephones.

The examples described above may be associated with an information and entertainment system, the SDS18and the method have been explained in the context of a vehicular environment. The SDS18and the method to carry out a speech dialogue between an SDS18and a user may be applied to dialogues between a user and a portable digital assistant (PDA) or in the context of computer-based dialogues via the telephone. In general, the speech dialogue could be applied for controlling the operation of any electronic device.

The SDS18may include a computer program product that includes one or more computer readable media that has computer executable instructions for performing the steps of the above method. In particular, the computer program product may provide instructions to the speech dialogue system for interrupting a speech dialogue between the user and the system and continuing the interrupted speech dialogue at the point where the dialogue was interrupted.