Patent Document ID: 8688446
Application ID: 13300505

Base Claim:
1. A system comprising: a mobile device configured to perform operations comprising: receiving a speech input, the speech input including a speech data stream; while receiving the speech input, receiving a non-speech input and time information associated with the non-speech input, the time information operable to specify a sequence in which the speech input and non-speech input are assembled, wherein the time information includes a start streaming node and a stop streaming node; retrieving text data from the speech input using speech recognition; assembling the text data with the non-speech input based on the time information to produce output data, wherein the assembling comprises modifying the text data in accordance with the non-speech input; and providing the output data to a user through a user interface.

---

Claim 6:
6. The system of claim 1 , wherein retrieving text data from the speech input includes one of: communicating with a speech recognition module located remotely from the one or more; or retrieving the text data using with a speech recognition module of the one or more computing devices.