Abstract:
Methods and systems are provided for processing speech inputs for a controlling one or more vehicle systems of a vehicle. In one embodiment, a method includes: receiving speech input from an audio channel; performing, by a processor, speech recognition on the speech input to obtain recognized results; determining, by a processor, an accuracy level of the audio channel based on a comparison of the recognized results and predictive phraseology; determining, by a processor, an integrity level of the audio channel based on situational awareness information; communicating the recognized results, accuracy level, and the integrity level to a vehicle system; and selectively using the recognized results by the vehicle system based on the accuracy level and the integrity level.

Description:
TECHNICAL FIELD 
       [0001]    The technical field generally relates to speech systems, and more particularly relates to methods and systems for determining a confidence level of voice recognition. 
       BACKGROUND 
       [0002]    Vehicle speech systems perform speech recognition on speech uttered by an occupant of the vehicle. The speech utterances typically include commands that control one or more features of the vehicle or other systems accessible by the vehicle. Conventional speech systems utilize generic recognition techniques such that speech utterances from any occupant of the vehicle can be recognized. Speech dialog systems manage a dialog with a user of the vehicle based on the commands. The dialog is typically generic for all users. 
         [0003]    However, modern voice recognition software in and of itself may not be able to address the varying levels of hardware and software criticality due to the performance stability of voice recognition, and its vulnerability to environmental interference. For example, different pilot voice characteristics may contribute to non-inconsistent recognition performance, different flight phases with different vehicle configurations may result in variable acoustical noise spectrums, different distance to the radio station imposes statics differently on the signal, etc. A method for generating a reliable voice recognition output accuracy and/or integrity level would provide an indication to the specific consumer functionality whether or not the data is eligible to be applied as input in terms of its criticality. 
         [0004]    Accordingly, it is desirable to provide methods and systems for determining a confidence level of voice recognition. It is further desirable to provide the confidence level in terms of accuracy and integrity. Furthermore, other desirable features and characteristics of the present invention will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and the foregoing technical field and background. 
       SUMMARY 
       [0005]    Methods and systems are provided for processing speech inputs for a controlling one or more vehicle systems of a vehicle. In one embodiment, a method includes: receiving speech input from an audio channel; performing, by a processor, speech recognition on the speech input to obtain recognized results; determining, by a processor, an accuracy level of the audio channel based on a comparison of the recognized results and predictive phraseology; determining, by a processor, an integrity level of the audio channel based on situational awareness information; communicating the recognized results, accuracy level, and the integrity level to a vehicle system; and selectively using the recognized results by the vehicle system based on the accuracy level and the integrity level. 
         [0006]    In another example, a system includes a non-transitory computer readable medium. The non-transitory computer readable medium includes a first module that performs, by a processor, speech recognition on a speech input received from an audio channel to obtain recognized results. The non-transitory computer readable medium further includes a second module that determines, by a processor, an accuracy level of the audio channel based on a comparison of the recognized results and predictive phraseology. The non-transitory computer readable medium further includes a third module that determines, by a processor, an integrity level of the audio channel based on situational awareness information, and that communicates the recognized results, the accuracy level, and the integrity level to a vehicle system. 
     
    
     
       DESCRIPTION OF THE DRAWINGS 
         [0007]    The exemplary embodiments will hereinafter be described in conjunction with the following drawing figures, wherein like numerals denote like elements, and wherein: 
           [0008]      FIG. 1  is a functional block diagram of a vehicle that includes a speech system in accordance with various exemplary embodiments; 
           [0009]      FIG. 2  is a dataflow diagram illustrating the speech system in accordance with various exemplary embodiments; and 
           [0010]      FIG. 3  illustrates exemplary data associated with the speech system in accordance with various embodiments; and 
           [0011]      FIG. 4  is a flowchart illustrating an exemplary speech method that may be performed by the speech system in accordance with various embodiments. 
       
    
    
     DETAILED DESCRIPTION 
       [0012]    The following detailed description is merely exemplary in nature and is not intended to limit the application and uses. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, brief summary or the following detailed description. As used herein, the term module refers to an application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and memory that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality. 
         [0013]    With initial reference to  FIG. 1 , in accordance with exemplary embodiments of the present disclosure, a speech system  10  is shown to be included within a vehicle  12 . As discussed in the exemplary embodiments herein, the vehicle  12  is an aircraft. As can be appreciated, the vehicle  12  can be an automobile, a watercraft, a sport utility vehicle, or any other type of vehicle or speech related application and is not limited to the present examples. 
         [0014]    The speech system  10  is configured to provide speech recognition capability for speech inputs  14  received through a human machine interface (HMI) module  16 . The HMI module  16  receives speech input directly from a user through an internal input device(s)  18  (e.g., a microphone present within the cockpit or other location of the vehicle), and/or indirectly, for example, from other users through an external input device(s)  20  that communicates speech signals to the vehicle  12  (e.g., an air traffic controller (ATC), radio broadcasts, etc.). 
         [0015]    The speech system  10  includes a speech module  22  that provides recognized speech output  24  to one or more vehicle systems  26 - 30 . Provided the aircraft example, such vehicle systems  26 - 30  can include, for example, but are not limited to, flight management systems, control systems, display systems, communication systems, navigation systems, or any other aircraft system that may include a speech dependent application. As can be appreciated, one or more embodiments of the speech system  10  can be applicable to other non-vehicle systems having speech dependent applications and thus, is not limited to the present vehicle example. For exemplary purposes, the speech system  10  will be discussed in the context of the vehicle example. 
         [0016]    In various embodiments, the speech system  10  communicates with the multiple vehicle systems  26 - 30  directly through a communication bus and/or other communication means  32  (e.g., wired, short range wireless, or long range wireless) and/or indirectly through the HMI module  16  (flow not shown). As can be appreciated, in various other embodiments not shown, the speech system  10  and/or HMI module  16  may be combined, and/or may be integrated with one or more of the vehicle systems  26 - 30 . 
         [0017]    Generally speaking, the speech system  10  validates speech inputs  14  periodically and/or upon events with predictive phraseology stored in a data storage device  34  and/or vehicle situational information  36  received from one or more of the vehicle systems  26 - 30 , such that a confidence level  38  can be determined and associated with the speech output  24 . The confidence level  38  is then made available to consumer functions of the vehicle systems  26 - 30 . The eligibility of certain voice recognition enabled features of the vehicle systems  26 - 30  can thus, be determined according to their criticality to the flight safety, equipment operation/interaction procedures, or other factors. 
         [0018]    Referring now to  FIG. 2 , a dataflow diagram illustrates the speech module  22  of the speech system  10  in accordance with various embodiments. As can be appreciated, various embodiments of speech module  22 , according to the present disclosure, may include any number of sub-modules. For example, the sub-modules shown in  FIG. 2  may be combined and/or further partitioned to similarly validate speech inputs and generate the confidence level  38 . In various embodiments, the speech module  22  includes a speech recognition module  40 , a speech validation module  42 , and a validation monitoring module  44 . As can be appreciated, the modules of speech system  10  can be implemented all on the vehicle  12  or part on the vehicle  12  and part on a remote system such as a remote server (not shown). 
         [0019]    The speech recognition module  40  receives and processes the speech input  14  from the HMI module  16 . For example, speech inputs  14  from one or more audio channels (e.g., radio TX/RX channels, intercom, etc.) are fed from the HMI module  16  (or other audio inputs) to the speech recognition module  40 . The speech recognition module  40  performs one or more speech recognition methods on the speech inputs  14  and produces recognized results  46  including for example, a digitalized output (e.g., in textual, and/or binary representations). 
         [0020]    The speech validation module  42  receives the recognized results  46  and validates the recognized results  46 . In various embodiments, the validation is performed for each channel. For example, the speech validation module  42  computes an accuracy level  48  (AL) of the recognized result  46  from a particular channel and associates a tag indicating the AL  48  to all messages associated with the particular channel. The AL  48  can be computed, for example, by comparing the content (e.g., codes, words, phrases, etc.) of the recognized results  46  to expected content and assigning a level (numeric or other descriptive level) based on the comparison. The expected content can be determined from predictive phraseology  47  retrieved from one or more information databases, procedural models, communication protocols, etc. stored in the data storage device  34 . 
         [0021]    In various embodiments, the speech validation module  42  maintains the AL  48  for the associated channel until a time elapses or an event occurs and is recognized as impacting the recognition. The event can include, for example, but is not limited to, an event that causes a change in the noise level, a change in speaker, turbulence or other environmental condition, distance from the transmitter, etc. 
         [0022]    The validation monitoring module  44  receives the recognized results and any other required information and determines an integrity level (IL)  50  for the validated recognized results. The validation monitoring module associates a tag indicating the IL  50  with all messages associated with the particular channel. The IL  50  can be computed, for example, by comparing the content of the recognized results to expected content and assigning a level based on the comparison. The expected content can be determined from situational awareness information  49  such as current vehicle configuration settings, situational data, etc. retrieved from the data storage device  34 . 
         [0023]    As shown in  FIG. 3 , the AL  48  and IL  50  are then provided along with the digitized output of the recognized results  46  to consumer functions of the vehicle systems  26 - 30 . The AL  48  and IL  50  act as the indicators for the confidence level  38 . In various embodiments, the validation monitoring module  44  includes a descriptive label with with the tag. The descriptive label indicates the cause for the updating of the IL  50 . For example, the descriptive label can indicate the situational awareness information that changed or that caused or did not cause the updating of the IL  50 . 
         [0024]    In various embodiments, the IL  50  is reset upon validation, and the IL  50  degrades over time and based on events which affect the channel, e.g., frequency change for a radio RX channel. For events or situation changes that don&#39;t significantly impact the given channel, the IL  50  may maintain its value, e. g., flaps deployment which changes cockpit noise level but has less impact to RX radio channel. 
         [0025]    Referring now to  FIG. 4  and with continued reference to  FIGS. 1-3 , a flowchart illustrates speech recognition and validation methods that may be performed by the speech system  10  in accordance with various exemplary embodiments. As can be appreciated in light of the disclosure, the order of operation within the methods is not limited to the sequential execution as illustrated in  FIG. 4 , but may be performed in one or more varying orders as applicable and in accordance with the present disclosure. As can further be appreciated, one or more steps of the methods may be added or removed without altering the spirit of the method. 
         [0026]    In one example, the method may begin at  100 . The speech input  14  is received at  110  and speech recognition is performed on the speech input  14  at  120 . The confidence level  38  is then selectively computed for the source of the speech input at  130 . For example, the accuracy level  48  and the integrity level  50  can be computed separately at  150  and  170  respectively. In various embodiments, the accuracy level  48  can be computed if, for example, one or more conditions exist (e.g., an occurrence of an event, a time lapse, and/or a certain phrase identified in the recognized results) for updating the confidence level  38  at  140 . The accuracy level  48  can be computed by comparing the content with expected content defined by, for example, by communication protocols, procedural manuals, information databases, etc. 
         [0027]    The integrity level  50  can be computed if, for example, one or more conditions exist (e.g., an occurrence of an event, a time lapse, and/or a certain phrase identified in the recognized results) for updating the integrity level  50  at  160 . The integrity level  50  can be computed based on the context of the speech input as indicated by the current configuration settings of the vehicle, and/or situational data provided by the vehicle or remote systems. The AL  48  and IL  50  are then provided along with the digitized output to consumer functions of the vehicle systems at  180 . The AL  48  and IL  50  are then evaluated by the consumer functions to selectively determine whether to rely on the speech input at  190 . Thereafter, the method may end at  200 . 
         [0028]    While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration of the disclosure in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the exemplary embodiment or exemplary embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope of the disclosure as set forth in the appended claims and the legal equivalents thereof.