Patent ID: 9274746
Filing Date: 2016-03-01
CPC Classification: G06F,G10L

Claim Text:
1. A computer system for displaying a multi-modal user interface comprising: a display; and a processor configured to display on the display a graphical user interface (GUI) supporting a plurality of different user input modalities including: i. one or more low delay input modalities, each of which responds to a low delay user input with a low delay, and ii. one or more high latency input modalities, each of which has a high response latency after receiving a high latency user input before providing a completed response to the high latency user input; wherein the computer system is configured to: accept, via the GUI, low delay and high latency user inputs in a sequence of mixed input modalities independently of response latencies without waiting for responses to high latency inputs as if each preceding user input in the sequence had been performed without response latencies; after receiving a first high latency user input followed by a subsequent low delay user input in the sequence of mixed input modalities, alter an appearance of a display corresponding to the low delay user input to indicate a possible change in a final result for the subsequent low delay user input pending a response from the first high latency user input; and accept user input for a second high latency input modality prior to providing a completed response to the first high latency user input.