Patent ID: 9462175
Filing Date: 2016-10-04
CPC Classification: G06K,H04N

Claim Text:
1. A digital annotation-based visual recognition book pronunciation system, the system comprising: a mobile device with a CPU, a memory unit, a display panel, an integrated camera lens, and a wireless transceiver for data communication; a mobile application program executed on the CPU and the memory unit of the mobile device, wherein the mobile application program extracts graphical feature points from a page image of a book captured by the integrated camera lens, transmits the graphical feature points to a digital annotation database executed in a cloud computing server, retrieves a book pronunciation content associated with the page image of the book, and superimposes an icon or a representation of the book pronunciation content on a real-time image of a nearby physical book, which is displayed on the display panel of the mobile device as a real-time augmented application; the digital annotation database executed in the cloud computing server, wherein the digital annotation database stores relational data between the page image of the book and the book pronunciation content recited by a human narrator; an image analysis and matching program executed in the cloud computing server, wherein the image analysis and matching program compares the graphical feature points from the page image of the book against a stored list of images or other graphical feature points in the digital annotation database, and wherein a correct image match allows the mobile device to retrieve the book pronunciation content associated with the page image of the book; the book pronunciation content decoded by the mobile application program and played back as a voice audio narration from the mobile device, wherein the voice audio narration is synchronized to a user's real-time page turn of the nearby physical book, which provides an automatic transition from one audio narration section to another audio narration section to match a textual content of a currently-viewed page of the nearby physical book captured by the integrated camera lens, as the user flips from a previous page to the currently-viewed page on the nearby physical book; and the cloud computing server configured to receive information from or transmit information to the mobile application program executed on the CPU and the memory unit of the mobile device via a wireless data network.