Patent Document ID: 8224650
Application ID: 10426057

Base Claim:
1. A computer readable storage medium having instructions, which when executed on a computer generate client side markup for a client in a client/server system, the instructions comprising: a set of multimodal controls defined on an authoring page for a website for defining visual renderings and at least one of recognition and audible prompting on a client in a server/client system, each multimodal control on the authoring page having a first set of attributes to control a first modality of visual rendering and a second set of attributes to control a second modality of at least one of recognition and audibly prompting the multimodal controls being related to client side markup executable by a client browser the set of multimodal controls comprising: a question control for generating markup related to audible prompting of a question; and an answer control for generating markup related to a grammar for recognition, the question and answer controls being associated with a semantic map comprising one or more semantic items that form a layer between individually associated visual domain primary controls and a non-visual recognition domain of the question and answer controls, the associated visual domain primary controls comprising markup; and a module operable on a computer, the module being configured to receive the authoring page and generate client side markup executable by the client browser on the client in the server/client system in accordance with the first and second sets of attributes of the multimodal controls on the authoring page.

---

Claim 7:
7. The computer readable storage medium of claim 1 wherein one of the second set of attributes for one of the controls provides instructions related to generating audible output.