A training free single camera gesture recognition system for remote controlling a TV using a low grade video and low computational equipment, which comprises: - a single video camera for capturing from a single lens and location at any given time at most a single video sequence of a user which is composed of video frames, and conveying the same into a hand tracker; - a hand tracker for receiving said video sequence, inspecting each of said video frames for possible inclusion of a user hand within it, and when a hand is determined to be found in a frame, calculating the hand centroid, and outputting the centroid coordinates into a trajectory buffer; - trajectory buffer for receiving from said hand tracker each of said hand centroid coordinates, and maintaining in storage at least several tens of recent hand centroids, that altogether define a trajectory of the hand; - trajectory segmentation module for continuously inspecting said buffer for inclusion of relevant trajectories of different lengths that are suspected to relate to a hand gesture pattern, and whenever a relevant trajectory is detected, extracting a trajectory segment of the same, and conveying it into a gesture classifier; and - said gesture classifier for extracting from each conveyed trajectory segment global feature parameters, being parameters of a bounding box placed around the centroid of that trajectory segment or being the number of times the trajectory passes a given coordinate value, comparing said extracted global feature parameters with gesture global predefinitions, concluding whether the segment relates to a specific gesture command, and in the affirmative case, transferring the command to the TV; said hand tracker comprising a switch for switching the hand tracker between a color-mode and a motion-mode, and wherein during a stationary state the tracker is in color-mode inspecting the scene to identify existence of a hand based on an expected hue of a hand, and upon such hand identification, the switch switches the tracker to a motion-mode for tracking a motion of the hand by inspecting the scene using a dynamic fusion of both hue and motion cues as determined by frame differencing, said tracker remaining in the motion mode as long as the motion amount between proximate frames is determined to be above a predefined threshold, and furthermore, said motion being inspected only within a window which is set around said calculated centroid. - a single video camera for capturing from a single lens and location at any given time at most a single video sequence of a user which is composed of video frames, and conveying the same into a hand tracker; - a hand tracker for receiving said video sequence, inspecting each of said video frames for possible inclusion of a user hand within it, and when a hand is determined to be found in a frame, calculating the hand centroid, and outputting the centroid coordinates into a trajectory buffer; - trajectory buffer for receiving from said hand tracker each of said hand centroid coordinates, and maintaining in storage at least several tens of recent hand centroids, that altogether define a trajectory of the hand; - trajectory segmentation module for continuously inspecting said buffer for inclusion of relevant trajectories of different lengths that are suspected to relate to a hand gesture pattern, and whenever a relevant trajectory is detected, extracting a trajectory segment of the same, and conveying it into a gesture classifier; and - said gesture classifier for extracting from each conveyed trajectory segment global feature parameters, being parameters of a bounding box placed around the centroid of that trajectory segment or being the number of times the trajectory passes a given coordinate value, comparing said extracted global feature parameters with gesture global predefinitions, concluding whether the segment relates to a specific gesture command, and in the affirmative case, transferring the command to the TV; said hand tracker comprising a switch for switching the hand tracker between a color-mode and a motion-mode, and wherein during a stationary state the tracker is in color-mode inspecting the scene to identify existence of a hand based on an expected hue of a hand, and upon such hand identification, the switch switches the tracker to a motion-mode for tracking a motion of the hand by inspecting the scene using a dynamic fusion of both hue and motion cues as determined by frame differencing, said tracker remaining in the motion mode as long as the motion amount between proximate frames is determined to be above a predefined threshold, and furthermore, said motion being inspected only within a window which is set around said calculated centroid.