Patent Document ID: 9811171
Application ID: 13786321

Base Claim:
1. A method of multimodal text input in a mobile device, the method comprising: using an original communication interface between an original keyboard module of the mobile device and a third party application to enable communication between a multimodal input module, that replaces the original keyboard module, and the third party application by: executing the multimodal input module by: steadily running the multimodal input module in the background of the mobile device and constantly monitoring in the background of the mobile device to detect when a text input field of the third party application is activated; and responding to detecting that the text input field of the third party application is activated by: activating a keyboard mode; displaying an A-Z-keyboard in a first field of a display for text input; automatically activating a camera mode when the keyboard mode is activated; capturing an image of written text having characters different from characters of the A-Z-keyboard, reducing a size of the A-Z-keyboard, displaying the A-Z-keyboard reduced in a reduced first field, and displaying the captured image with the written text in a second field of the display of the mobile device, the reduced first field and the second field together occupying a same field size as the first field; converting the captured image to character text by optical character recognition (OCR) and displaying the recognized character text on the display; and outputting a selected part of the recognized character text as the input text to the third party application receiving the input text upon a selection of the part of the recognized character text, wherein the outputting to the third party application from the multimodal input module is via the original communication interface to the third party application as between the original keyboard module and the third party application, and wherein the multimodal input module is configured to enable the respective selection to take place by a single keypress or control command, or by a single gesture.

---

Claim 5:
5. The method according to claim 1 , wherein in the activated camera mode the second field is displayed adjacent to the keyboard.