Patent ID: 8571851

Claim:
A computer-implemented method for semantically interpreting speech recognition results using gaze tracking data, the method comprising: obtaining data identifying a sequence of gaze attention dwell positions and a gaze order associated with each gaze attention dwell position, wherein a gaze attention dwell position corresponds to a position on a user interface in which a duration of attention on a single element satisfies a minimum dwell time threshold; after obtaining the data identifying the sequence of gaze attention dwell positions and the gaze order associated with each gaze attention dwell position, receiving audio data encoding an utterance; obtaining a transcription of the utterance; correlating the gaze attention dwell positions and the gaze order associated with each gaze attention dwell position with a semantic description of elements displayed on a visual display to identify one or more particular elements and a respective gaze order associated with each particular element; performing semantic interpretation of at least one term included in the transcription based at least on the gaze order associated with the particular elements; and outputting a result of performing the semantic interpretation of the at least one term.