Patent ID: 7430324
Filing Date: 2008-09-30
Classification: G06F

Abstract:
1. A method for generating joint multimodal interpretations, comprising: receiving a set of multimodal interpretations that are generated within a turn by a set of modalities, wherein each multimodal interpretation is one of either a non-ambiguous interpretation or an ambiguous interpretation of a subset of ambiguous interpretations of the set of multimodal interpretations, and wherein each multimodal interpretation is identified with the modality that has generated the multimodal interpretation, and wherein each multimodal interpretation is assigned an interpretation type and confidence score; and generating a set of joint multimodal interpretations comprising all possible joint multimodal interpretations, each of which is formed from one of all possible combinations of multimodal interpretations of the set of multimodal interpretations such that each joint multimodal interpretation has no more than one ambiguous interpretation from each subset of ambiguous interpretations, and such that the multimodal interpretations of each joint multimodal interpretation satisfy an interpretation type relationship of a defined set of interpretation type relationships based on the interpretation type and modality of each multimodal interpretation.