Patent ID: 11960636
Assignee: MAGIC LEAP, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC F  G

Claim 7:
8. A system comprising:
a display of a wearable system configured to present virtual content to a user;
a gesture tracking device configured to acquire data indicating hand gestures of the user;
an audio sensing device configured to capture words spoken by the user and to generate speech data;
an eye gaze tracking device of the wearable system configured to track a gaze of the user; and
a hardware processor communicatively coupled to the display, the gesture tracking device the audio sensing device, and the eye gaze tracking device, the hardware processor being programmed to:
obtain a transcription of one or more words spoken by the user into text, based at least in part on the speech data from the audio sensing device;
control the device to present the text to the user;
identify a user-selected portion of the text utilizing an aggregated confidence score, the aggregated confidence score determined by the system based at least in part on (i) a first confidence score calculated by an eye gaze cone case performed utilizing eye gaze direction data obtained from the eye gaze tracking device, and (ii) a second confidence score calculated utilizing hand gesture data provided by the gesture tracking device;
after identifying the user-selected portion of the text, determine whether the user has given a user input command to edit the user-selected portion of the text; and
perform an editing action on the user-selected portion of the text in accordance with the user input command.