Patent ID: 6868383

Claim:
A multimodal recognition system that inputs an utterance comprising a plurality of associated modes, the system comprising: a plurality of mode recognition systems, each mode recognition system usable to recognize ones of the associated modes, each mode recognition system outputting a recognition result for each associated mode; and a multimodal recognition system that inputs recognition results from at least a first one of the plurality of mode recognition systems, that generates, for at least a second one of the plurality of mode recognition systems distinct from the at least first one of the plurality of mode recognition systems, at least one recognition model based on the recognition results from the at least first one of the plurality of mode recognition systems, and that outputs each generated recognition model to a corresponding one of the at least second one of the plurality of mode recognition systems; wherein each corresponding mode recognition system of the at least second one of the plurality of mode recognition systems generates the recognition result for the associated mode for that corresponding mode recognition system based on the corresponding generated recognition model.