Patent ID: 8311835

Claim:
A client-server system for providing assisted multi-modal dialogue, comprising: a web server for generating client-side markups having recognition and audible prompting for execution on a client having recognition capabilities, the web server further including controls for generating the client side markups, the controls including speech controls inheritance for setting values to properties associated with the controls and organized in collections to construct a dialog for obtaining information pertaining to a plurality of topics, each collection of controls configured to create a separate dialog associated with a separate topic; a recognition server, coupled to the web server, for providing speech recognition processing to received voice data based on a grammar or language model provided with the received voice data to produce speech recognition results, the speech recognition results being provided to the web server; and a telephone voice browser, coupled to the web server, for processing voice data, the telephone voice browser including a media server for providing a telephony interface and a voice browser; wherein the controls of the web server include companion controls associated with corresponding primary controls for providing recognition and audible prompting, the companion controls including a semantic map, wherein the semantic map includes semantic items and forms an association between a visual domain of the primary controls and a non-visual recognition domain of the companion controls and wherein the dialog includes at least one question provided by a prompt object and at least one answer, a grammar object is provided to define a grammar for recognition of input data and related processing on the input and an answer property associates a recognized result with a semantic item in the semantic map.