An imaging processing method for an image processing apparatus, the image processing method comprising the steps of: supplying captured images frame-by-frame to a frame buffer ; reading captured images from the frame buffer and detecting a first gesture of a user's hand as a trigger and detecting a second gesture of a user's hand as a second trigger within a predetermined period of time after the detection of the first trigger, and supplying to a feature point extraction unit first area information of said images corresponding to the first trigger, and supplies second area information corresponding to the second trigger; extracting, by the feature point extraction unit , a feature point corresponding to a hand of a user in said images defined by said first area information, and extracting a feature point of a hand of a user in said images defined by said second area information, performing control, based on the current positions of the feature points, to cause a display means to display feature-point pointers indicating the current positions of the feature points in the captured images and predetermined user interfaces ; recognizing feature points that are indicated by the feature point pointers grabbed with a user's hand; reading, following the step of recognising, consecutive frames of the captured image from the frame buffer and calculating the optical flow of each feature point to recognize the current position of each feature point; issuing for each of the feature points, based on the recognized position of the feature point in the captured image, a command corresponding to the position of the feature point, or issuing a command for each of the feature points based on the motion of the feature point from the optical flow of the feature point corresponding to a predefined motion, said command corresponds to the user interface that is being displayed at the position of the feature point, and wherein the predetermined user interfaces are shared by the plurality of feature points. supplying captured images frame-by-frame to a frame buffer ; reading captured images from the frame buffer and detecting a first gesture of a user's hand as a trigger and detecting a second gesture of a user's hand as a second trigger within a predetermined period of time after the detection of the first trigger, and supplying to a feature point extraction unit first area information of said images corresponding to the first trigger, and supplies second area information corresponding to the second trigger; extracting, by the feature point extraction unit , a feature point corresponding to a hand of a user in said images defined by said first area information, and extracting a feature point of a hand of a user in said images defined by said second area information, performing control, based on the current positions of the feature points, to cause a display means to display feature-point pointers indicating the current positions of the feature points in the captured images and predetermined user interfaces ; recognizing feature points that are indicated by the feature point pointers grabbed with a user's hand; reading, following the step of recognising, consecutive frames of the captured image from the frame buffer and calculating the optical flow of each feature point to recognize the current position of each feature point; issuing for each of the feature points, based on the recognized position of the feature point in the captured image, a command corresponding to the position of the feature point, or issuing a command for each of the feature points based on the motion of the feature point from the optical flow of the feature point corresponding to a predefined motion, said command corresponds to the user interface that is being displayed at the position of the feature point, and wherein the predetermined user interfaces are shared by the plurality of feature points. <EOS>