Patent ID: 9311724
Filing Date: 2016-04-12
CPC Classification: G06F,G06T

Claim Text:
1. A method of creating a virtual image of at least portions of the user's hand or hands while operating a handheld computerized device, said handheld computerized device comprising at least one touchpad, at least one graphics display screen, at least one image sensor configured to photograph at least part of the region of space proximate said at least one touchpad, but not configured to photograph the surface of said touchpad, at least one processor, memory, and software, said method comprising: obtaining data on the location and movement of the user's fingers and/or hand using said touchpad, said user's fingers and/or hand being positioned in an arbitrary manner with respect to said touchpad when contacting said touchpad, said data not being associated with an image of the user's fingers from said image sensor, said at least one image sensor comprising at least one video camera; said touchpad being located in a location of said handheld computerized device that is different from the location of said at least one display screen; analyzing said data from said touchpad on the location and movement of said user's fingers and/or hand according to a model of a human hand, and assigning said data on the location and movement of said user's fingers and/or hand to specific fingers on said model of said human hand, thereby making predictions as to the location of the user's hand and fingers; using said model of said human hand, and said predictions of the location of the user's hand and fingers, to compute a graphical representation of at least said user's fingers; further using images of portions of the user's hand or hands that do not contain images pertaining to the position of the user's fingers to further supplement or refine said model of said human hand; and displaying said graphical representation of at least said user's fingers on said at least one graphics display screen of said handheld computerized device.