Patent Document ID: 9348417
Application ID: 12917331

Base Claim:
1. In a computing environment, a method performed at least in part on at least one processor, the method comprising: receiving sets of input data corresponding to a plurality of input modalities, the received sets of input data including a first set of input data and a second set of input data, the first set of input data being associated with a first input modality from the plurality of input modalities, the second set of input data being associated with a second input modality from the plurality of input modalities; selecting the first set of input data and the second set of input data based on one or more of the following: user defined preferences, and a current operating mode of a program; accessing a dictionary to determine a combined meaning of the first and second set of input data; receiving environmental input from one or more sensors; and providing output data for input by the program, the output data corresponding to the combined meaning of the first and second set of input data and the environmental input.

---

Claim 4:
4. The method claim 1 wherein receiving the sets of input data comprises receiving at least one set as input that is synthesized from output of another device.