Abstract:
For retrofitting an infotainment system of a motor vehicle which has the option of operating using voice commands, such voice commands are subsequently defined in an SCXML file. The voice commands are assigned state transitions, which are intended to run through the functional devices after the corresponding voice command is received. The SCXML file is interpreted by an interpreter.

Description:
CROSS REFERENCE TO RELATED APPLICATIONS 
       [0001]    This application is based on and hereby claims priority to International Application No. PCT/EP2012/002659 filed on Jun. 23, 2012 and German Application No. 10 2011 109 932.1 filed on Aug. 10, 2011, the contents of which are hereby incorporated by reference. 
       BACKGROUND 
       [0002]    The invention relates to a method for controlling functional devices in a vehicle by a device which can be operated via voice commands. 
         [0003]    In a motor vehicle, a so-called infotainment system can process different types of data depending on functionality. For example, the infotainment system comprises an audio device for the acoustical reproduction of audio data, whether these are data from a data medium or those of a radio program which are transmitted wirelessly; the infotainment system also comprises a navigation device which outputs map data via a display device and places them in relation to a current position, possibly also a target position, of the vehicle; the infotainment system can also comprise a hands-free talking device which enables the vehicle device to be coupled to a mobile radio telephone. 
         [0004]    The device, with the aid of which such devices of the vehicle can be controlled, can comprise operating elements such as, for instance, keys, the operation by voice input, that is to say voice commands, being predominant in the present case: there is thus a microphone and a device for analyzing the data recorded by the microphone in the sense of voice recognition. 
         [0005]    For the purpose of voice recognition, a relatively large amount of effort must be made relating to the hardware to be made available, especially also the memory, apart from the processor, and a particular computing time must be made available for a particular processor. So that the effort is not allowed to grow excessively, the remedy has hitherto been to provide voice operation only to a limited extent, namely by defining a number of voice commands which provide for operation. In this manner, the range of functions of the (voice control) system must be specified precisely at the time of delivery of the vehicle. It is equally not possible to flexibly specify a new functionality on a mobile radio telephone even if the functionalities are provided via the latter. 
         [0006]    It would be nice to be able to define new functionalities at a later time. This has previously been possible to a restricted extent by utilizing web browsers (for example by utilizing the HTML and WAP formats). Using such web browsers, however, only makes it possible to implement a voice output but not a voice input for providing novel ways of control (new events in the case of the provision of new functions). 
         [0007]    US 2004/0193420 A1 describes a method for processing voice commands in a motor vehicle. In this method, corresponding files are exchanged in which a method of control for a functional device is stored. The files can be received by a device different from the vehicle. The functional device can thus be controlled via the voice command. 
         [0008]    Furthermore, US 2002/0069063 A1 describes a home network having digital interfaces. Devices can be coupled to the digital interfaces and controlled via voice commands. 
         [0009]    In addition, a control system for aircraft which can be controlled via voice inputs is known from US 2007/0288242 A1. The control system can comprise a host processor which is coupled to a database for storing and receiving voice commands. 
         [0010]    DE 199 42 869 A1 describes a method for operating a voice-controlled device in motor vehicles, in which method the voice commands are assigned to a device function in the motor vehicle via a speech pattern comparison. In this context, data or functions arriving via telematics services can also be transcribed ad hoc into voice-command-controllable speech patterns. 
         [0011]    From US 2008/0103779 A1, a method for receiving voice commands is known by which vehicle functions can be controlled. 
         [0012]    Finally, US 2009/0055178 A1 describes a method for acquiring voice commands in a motor vehicle. In this method, in addition to the voice command, a position is also determined from which the voice command emanates. 
       SUMMARY 
       [0013]    It is thus one possible object to provide a method of the type initially mentioned which is especially suitable for retrofitting a preexisting system, especially the infotainment system. 
         [0014]    The inventors propose a method for controlling functional devices in a vehicle by a device which can be operated via voice commands. The method thus comprises the following:
       receiving a file with data which specify at least one voice command and, in association therewith, a method of control for a functional device, and the file being received by the vehicle from a device different from the vehicle,   receiving a voice input by the vehicle, especially by the device,   comparing the voice input with the at least one voice command from the file and, if a correspondence with one of the voice commands is found in accordance with a predetermined criterion,   controlling the functional device in accordance with the method of control belonging to the one of the voice commands with which the correspondence is found, wherein   the file is received by a mobile radio device ( 200 ) and—the file has an XML format, preferably an SCXML format, and is interpreted by an interpreter, and   an application which is stored on the mobile radio device and can be executed there is accessed via at least one of the voice commands.       
 
         [0021]    In the proposed method, the voice command as such, and the matter to be effected following this voice command, is thus conveyed to the vehicle or to the device of the vehicle, respectively, via a file. By receiving a file in the context of retrofitting the vehicle, in which voice commands could already have been stored previously, the previous set of voice commands can be extended, especially subsequently extended. 
         [0022]    In a preferred embodiment, a state related to the device or a functional device to be controlled by the device is allocated to at least a part of the voice commands. Before comparing, the state is determined. Then comparing takes place only with those voice commands to which the same state is allocated, or so-called general voice commands to which no specific state at all is allocated. In order to facilitate the voice recognition, it is taken into consideration here that in a particular state, only a restricted number of voice commands is appropriate so that only this restricted type of voice commands needs to be recognized. The state is followed by the method of control, that is to say a so-called event which changes the state. 
         [0023]    This can then result in a further state and receiving a voice input and of comparing and subsequently controlling can be performed again. In this manner, a complex voice dialogue can be realized which is accompanied by complex operating processes within the flexible function subsequently loaded. 
         [0024]    The received file has an XML format, preferably an SCXML format, and the file is then interpreted in a manner known per se by an interpreter which is a part of the device which can be operated via voice commands: an interpreter converts commands from an XML file immediately into control signals. The XML format is particularly suitable for conveying the voice commands and for that which is to be effected by the voice commands. This is because the XML format is independent of platform and can be processed therefore by different systems. 
         [0025]    In an alternative, the pronunciation of the at least one voice command is specified by the data, e.g. in a type of phonetic language. As an alternative, the notation of the at least one voice command is specified by the data so that the device can infer the pronunciation by a basic grammar or conversely can infer the pronunciation of a particular voice command by the pronunciation. Both alternatives are advantageous depending on context. Specifying the pronunciation by the data has the advantage that the device can access the data directly; on the other hand, specifying the notation of the voice command can be implemented somewhat more simply. 
         [0026]    In a preferred variant, the file is received by a server external to the vehicle. Such servers can be provided by the manufacturer (OEM), for example by the manufacturer of the vehicle who can perform updates in the functionalities of the vehicle with the aid of the file conveyed. The vehicle can thus be upgraded following a simple inquiry from the manufacturer. There is thus a simple addressee for the vehicle to whom one can turn for upgrading. 
         [0027]    Naturally, other persons and companies can also be responsible for such a server. 
         [0028]    In this variant, the file is received preferably via a mobile radio link, e.g. UMTS or LTE, namely especially via the Internet. A file to be downloaded can be selected especially easily via the Internet, especially in conjunction with a device of the infotainment system which can be operated easily by an operator. To download the files, voice commands do not need to be necessarily used and keys and other haptic operating elements can be operated. 
         [0029]    According to the proposal, the file is received by a mobile radio device. Upgrading is known as being common to a high degree especially in the case of mobile radio devices. Using a mobile radio device, so-called applications (apps) can be downloaded. If it is then required to operate these apps from the vehicle, that is to say via the man-machine interface of the vehicle including the device which can be operated via voice commands, only the file needs to be generated (for instance in the XML format) by the mobile radio device and conveyed or simply forwarded to the vehicle; the application deposited in the mobile radio device can then also be controlled from the vehicle. The functional device is then thus part of the mobile radio device, but controlling takes place in the vehicle. 
         [0030]    In this variant, the data are received preferably via a wireless link different from a mobile radio link; this is because mobile radio devices can be coupled to the vehicle via corresponding interfaces, for example via Bluetooth®. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0031]    These and other objects and advantages of the present invention will become more apparent and more readily appreciated from the following description of the preferred embodiments, taken in conjunction with the accompanying drawing of which: 
           [0032]      FIG. 1  illustrates the software modules necessary for implementing one embodiment of the proposed method and the exchange processes between these. 
       
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
       [0033]    Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawing, wherein like reference numerals refer to like elements throughout. 
         [0034]    A vehicle designated by  100  overall has an infotainment system  10  delimited by a dashed line. In this system, a voice input which can be interpreted as a voice command due to voice recognition is provided for especially via a man-machine interface. The infotainment system  10  also includes further interfaces, for example an interface  14  to a navigation device, an interface  16  for a telephone device, an interface  18  for a multimedia device etc. 
         [0035]    In the infotainment system  10 , a finite number of voice commands are stored for the voice control which correspond to so-called events, that is to say processes which alter an (informational) state of the infotainment system or of a device controlled via the interfaces  14 ,  16 ,  18 , respectively, of the latter into a corresponding different state. 
         [0036]    In the present case, the number of commands is to be extended in order to provide new functionalities in the infotainment system  10 . For this reason, a data link  20  is established between the infotainment system  10  of a device  200  different from the vehicle  100 . In one variant, the device can be a server external to the vehicle, in another variant, it can be a mobile radio telephone which is carried along in the vehicle  100 . The vehicle  100  or its infotainment system  10 , respectively, then sends an inquiry to the device  200  whereupon the latter sends an SCXML file  22  to the infotainment system  10 , that is to say a text file. The SCXML file comprises information relating to at least one name of a command which, in the present case, is to be deliverable via voice control, that is to say a voice command, and in addition to each voice command, an event, that is to say a change in state. 
         [0037]    In the infotainment system  10 , an interpreter  24 , which interacts with a digital interface  26  for the man-machine interface, interprets the SCXML file. According to the arrow  28 , the interpreter  24  conveys a table to the interface  12  which allocates the voice commands to the events to be implemented. A voice command is then input via the interface  12 . The interface  12  then determines initially the existing (informational) state because, if it is a matter of state transitions, it must be clear initially which states are used as a basis. Now, state transitions (events) which are based on the prevailing state are defined only with respect to a limited number of voice commands; only these are subsequently included, together with possibly generally defined voice commands (such as, e.g., the always valid “abort” or the like). The interface  12  then compares the voice input with the available (that is to say valid in the present state) voice commands and finds out the voice command to which the voice input corresponds. According to the arrow  30 , corresponding information is conveyed to the interpreter  24  which then accordingly causes state transitions (events), especially by using the interfaces. 
         [0038]    Thus, the vehicle  100  or its infotainment system  10 , respectively, can be extended by additional information by conveying the SCXML file  22 . 
         [0039]    In the case where the device  200  is a server external to the vehicle, this server can be provided by the manufacturer of the vehicle  100 . For example, with each start of the vehicle  100  or of functional units thereof or at repetitive time intervals or after particular driving distances or driving times, a vehicle  100  or its infotainment system  10 , respectively, can make a request to the external server  200  so that current functionalities are always kept available in the vehicle  100 . 
         [0040]    The device  200  can also be a mobile radio telephone which is coupled to the infotainment system  10  via Bluetooth®, WLAN, USB cable, iphone® cable or the like. In this case, conveying the SCXML file  22  enables apps (applications) stored on the mobile radio telephone and executable there to be accessed via voice commands which are input via the infotainment system  10  and were previously not known. 
         [0041]    The invention has been described in detail with particular reference to preferred embodiments thereof and examples, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention covered by the claims which may include the phrase “at least one of A, B and C” as an alternative expression that means one or more of A, B and C may be used, contrary to the holding in  Superguide v. DIRECTV,  69 USPQ2d 1865 (Fed. Cir. 2004).