Abstract-Since the advent of multitouch screens users have been able to interact using fingertip gestures in a two dimensional plane. With the development of depth cameras, such as the Kinect, attempts have been made to reproduce the detection of gestures for three dimensional interaction. Many of these use contour analysis to find the fingertips, however the success of such approaches is limited due to sensor noise and rapid movements. This paper discusses an approach to identify fingertips during rapid movement at varying depths allowing multitouch without contact with a screen. To achieve this, we use a weighted graph that is built using the depth information of the hand to determine the geodesic maxima of the surface. Fingertips are then selected from these maxima using a simplified model of the hand and correspondence found over successive frames. Our experiments show real-time performance for multiple users providing tracking at 30fps for up to 4 hands and we compare our results with stateof-the-art methods, providing accuracy an order of magnitude better than existing approaches.
Krejov and Bowden REF presented a system using a weighted graph and depth information of the hand for determining the geodesic maxima of the surface.
Multi-touchless: Real-time fingertip detection and tracking using geodesic maxima
2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
Mathematics Computer Science