Patent ID: 8660841

Claim:
Apparatus for cross-modal association of events from a complex source having at least a first and a second modality, multiple objects, and events, the apparatus comprising: an input for receiving first data from a first recording device, said first data relating to said first modality; an input for receiving second data from a second recording device, said second data relating to said second modality; an associator configured for iteratively associating event-related changes recorded in said first mode and event-related changes recorded in said second mode according to a predetermined maximum likelihood criterion, said likelihood criterion, over said iteration, obtaining a score for respective event related changes in said first mode and reinforcing respective associations where event related changes are repeated and reducing respective associations where event related changes are not repeated, said associator configured to provide an association between events belonging to said changes using a result of said iteration, by selecting a best score, thereby not pregrouping said event-related changes into different coherent groups expected to repeat themselves; a first output connected to said associator, configured to indicate ones of the multiple objects in the second modality being associated with respective ones of the multiple events in the first modality.