Interactive recognition of simultaneous manipulative hand movements
Automatic recognition of manipulative hand movements is a critical step in developing programming by human demonstration technology and intuitive human interfaces to virtual reality. Interactive recognition of manipulative hand movements relies on extracting a meaningful vector of features on-line and on classifying it interactively. Our working model is that hand movements involve joint coordination. with close to in-phase (zero relative-phase) or close to anti-phase (half a cycle relative-phase) coordination [1-3]. In these cases a coordinated hand movement traces a straight line in the joint space. and is characterized by the corresponding vector of direction numbers. We present a real-time algorithm fur extracting the vector of direction numbers on-line. and a neural network for its interactive classification. We focus on the recognition of simultaneous hand movements, which involves a single coordinated pattern of digit movements, and demonstrate successful recognition of simultaneous hand movements. (C) 2000 Elsevier Science Ltd. All rights reserved.
interactive recognition manipulation programming by human demonstration coordination gesture recognition art