Patent Document ID: 9519640
Application ID: 13464945

Base Claim:
1. A method for presenting a translation of a real world expression to a wearer of a see-through head mounted display apparatus, comprising: determining a three dimensional location of one or more objects in a field of view of the wearer through the see-through head mounted display apparatus, the determining of the three dimensional location of the object is performed using one or more sensors; receiving a selection of data for translation in the field of view of the wearer by reference to a gaze of the wearer at the item of data; analyzing the data for translation to provide input data, the input data having one or more of a linguistic translation input, supplemental information input and contextual input; analyzing the input data to determine whether each of a linguistic translation, an informational translation, and a context translation should be provided based on the input data and a wearer profile, wherein the linguistic translation is a translation from one language to another, the information translation provides additional information regarding the selected item and the contextual translation is a translation based at least in part on a context of another user providing the input data, wherein the linguistic, informational and context translations are different types of translations; determining wearer knowledge of subject matter in the analyzed input data from the wearer profile; determining a complexity of the translation based on the determined wearer knowledge; determining one of a plurality of output formats for the translation based on the input data; translating the input data into a translated form for the wearer, the translation based on the determined translation type and the determined translated complexity, the translated form based on the determined one of the plurality of output formats; and rendering the translation in at least one of the plurality of output formats determined, the output format selected from at least an audio translation format and a visual translation format rendered in the see-through head mounted display.

---

Claim 8:
8. The method of claim 1 wherein the sensors include audio sensors and the step of receiving a selection of data includes receiving audio data and analyzing the data including isolating audio data based on the gaze to provide the input data.