Patent Document ID: 9898809
Application ID: 14936915
Patent Status: 1

Claim One:
1. An input system allowing a user to interact with a mobile device via a keyboard including a plurality of keys, comprising: a processor system including at last one processor, the processor system being configured to at least: capture a plurality of images in connection with the keyboard and/or at least one hand typing on the keyboard via a camera, locate the keyboard based on at least one of the plurality of images that is captured while the keyboard is not being typed on by the user; extract at least a portion of the keys on the located keyboard based on at least one of the plurality of captured images; extract a hand based on at least one of the plurality of captured images; detect a fingertip of the extracted hand based on at least one of the plurality of captured images; detect and localize a keystroke through tracking the detected fingertip based on at least one of the plurality of captured images; and determine a character corresponding to the localized keystroke.