Patent Document ID: 10078376
Application ID: 15636189
Patent Status: 1

Claim One:
1. A method for multimodal text input in a mobile device comprising a touch screen display, a touch screen A-Z keyboard and a camera, the method comprising: using an original communication interface between a third-party application and an original keyboard module, wherein the original keyboard module is replaced by a multimodal text input module communicating with said third-party application instead of the original keyboard module; said third-party application requesting an input text through a text input field; executing the multimodal text input module by running the multimodal text input module in the background of the mobile device and constantly monitoring the background of the mobile device to detect when the text input field of the third-party application is activated; wherein the multimodal text input module simultaneously activates both a keyboard mode and a camera mode, said keyboard mode configured to: display an A-Z keyboard in a first field of the touch screen display for a character selection for the text input, sense for a manual selection of one or more selected characters of the A-Z keyboard and outputting the selected characters to the text input field of the third-party application; and said camera mode configured to: capture an image of a written text by the camera; display said captured image in a second field of the display; convert said captured image to recognized character text by optical character recognition (OCR); display the recognized character text as an overlaid text over the original text within the captured image, and sense for a manual selection of a part of the displayed recognized character text and outputting said selected part of the recognized character text to the text input field of the third-party application; wherein said capturing, displaying of said captured image, converting, and displaying of said recognized character text is capable of being accomplished by a single operation comprising a single keypress, a control command or a single gesture.