Patent ID: 9600135
Date: 2017-03-21
CPC Classifications: G06F,G10L

Claim:
1. A multimodal system for processing information, the system comprising: a computer device having a processing system with at least one processor; a plurality of input mode components coupled with the computer device for providing input data to the computer device, the plurality of input mode components including at least one microphone coupled with a speech recognition element for processing user speech; and a plurality of output mode components coupled with the computer device for handling output data from the computer device, the plurality of output mode components comprising a display, and a speaker coupled with a voice synthesizer; the processing system of the computer device being configured to: wherein the processing system is configured so that, in response to speech input data not being timely received from the user for a current prompt, the processing system provides, by way of the speaker, a voice indication that is associated with the current prompt so that the user may provide speech input data for addressing the current prompt; wherein the processing system is configured so that, in response to speech input data being timely received from the user for a current prompt, the processing system does not provide by way of the speaker the voice indication that is associated with the current prompt; and wherein the processing system reorders said visual indications as the prompts are addressed to continue guiding the user to a proper speak-ahead order that associates all of said speech input data respectively with the prompts sequentially as said speech input data is received from the user by way of the at least one microphone.