Patent ID: 9548052
Date: 2017-01-17
CPC Classifications: G06F,G09G,G10L

Claim:
1. A computer-implemented method of interacting with an ebook using speech recognition, comprising: presenting, on a display of a user device, a displayed portion of an ebook; receiving, at the user device, audio data of a user reading aloud the displayed portion of an ebook; converting a portion of the audio data to spoken-text data; determining one or more similarity scores based on a comparison between the spoken-text data and text data associated with the displayed portion of the ebook; weighting the one or more similarity scores based in part on a location of a previously emphasized word that corresponds to a previous reading location of the user in the text data and a time elapsed since the previously emphasized word was emphasized; ranking the one or more weighted similarity scores; determining a reading location in the text data that corresponds to the spoken-text data based on the ranking of the one or more weighted similarity scores; determining a pronunciation score using the spoken-text data and pronunciation data associated with the text data at the reading location; performing one or more actions based in part on the reading location and the pronunciation score, the one or more actions including: outputting the performed one or more actions on the display of the user device.