Patent ID: 11960636
Assignee: MAGIC LEAP, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC F  G

Claim 14:
15. A method carried out by a wearable system including a head-mounted display (HMD), an eye gaze tracking device, a gesture tracking device, and a hardware processor coupled to the HMD, to the eye gaze tracking device, and to the gesture tracking device, the method comprising:
under control of a hardware processor:
receiving spoken input from a user from a microphone;
translating the spoken input into text including a plurality of words;
causing a wearable display to present the text to the user;
identifying a selection of a portion of the presented text in the displayed text; and
providing the user with an opportunity to edit the portion of the presented text;

wherein identifying comprises:
determining a first confidence score for the selected portion of the presented text utilizing eye gaze direction data received from the eye gaze tracking device;
determining a second confidence score for the selected portion of the presented text utilizing hand gesture data received from the gesture tracking device;
calculating an aggregated confidence score for the selected portion of the presented text based, at least in part, on at least the first confidence score and the second confidence score; and
utilizing the aggregated confidence score to identify the selected portion of the presented text.