Patent ID: 8055504

Claim:
A method for synchronizing visual and speech events in a multimodal application, the method comprising: calling a voice form of the multimodal application, wherein the multimodal application is run using at least one computer processor, wherein the multimodal application provides a multimodal web page to a client device over a network; receiving speech from a user; determining a semantic interpretation of at least a portion of the speech using the voice form; calling a global application update handler of the multimodal application and exiting the voice form; identifying, by the global application update handler, an additional processing function in dependence upon the semantic interpretation, wherein the additional processing function is independent of the voice form; and executing the additional processing function to synchronize visual and speech events in the multimodal application, wherein determining a semantic interpretation of at least a portion of the speech comprises determining a plurality of semantic interpretations of the at least a portion of the speech, and wherein identifying, by the global application update handler, an additional processing function in dependence upon the semantic interpretation comprises identifying, by the global application update handler, an additional processing function for each of the plurality of semantic interpretations.