An image processing apparatus comprising: a reproducing unit configured to reproduce and display video data captured by an imaging apparatus in a predetermined display area on a display device; a designating unit configured to accept a user operation with respect to the display area in a state where a frame specified based on a user operation is displayed on the display area, and designate a plurality of designation areas in the specified frame in accordance with the user operation with respect to the display area; a registering unit configured to register a plurality of reference colors using a color of a pixel present in each of the designation areas; a feature area detecting unit configured to detect a plurality of feature areas based on the plurality of reference colors that is registered by the registering unit, in a first frame of the video data displayed by the reproducing unit, wherein the feature detecting unit is configured to detect the plurality of feature areas by binarizing the first frame by extracting only pixels whose pixel values are included in any of the plurality of reference colors and by performing a labelling process on the binary image; and a tracking area detecting unit configured to detect an area including the plurality of feature areas as a tracking area that includes tracking targets, based on a distance between the plurality of feature areas detected by the feature area detecting unit, wherein a trajectory line indicating a trajectory of a tracking target is displayed in a superimposed manner on the video data and wherein, when a part at which lines of the trajectory line displayed in the display area intersect with each other is selected through an operation of the input unit, the reproducing unit performs display to receive selection regarding which of the lines intersecting each other is to be selected, characterized in that the reproducing unit is configured to display a frame selection window if a part at which lines intersect with each other is operated, wherein the frame selection window is displayed to allow a user to select any of frames with dates and times corresponding to the intersecting lines. a reproducing unit configured to reproduce and display video data captured by an imaging apparatus in a predetermined display area on a display device; a designating unit configured to accept a user operation with respect to the display area in a state where a frame specified based on a user operation is displayed on the display area, and designate a plurality of designation areas in the specified frame in accordance with the user operation with respect to the display area; a registering unit configured to register a plurality of reference colors using a color of a pixel present in each of the designation areas; a feature area detecting unit configured to detect a plurality of feature areas based on the plurality of reference colors that is registered by the registering unit, in a first frame of the video data displayed by the reproducing unit, wherein the feature detecting unit is configured to detect the plurality of feature areas by binarizing the first frame by extracting only pixels whose pixel values are included in any of the plurality of reference colors and by performing a labelling process on the binary image; and a tracking area detecting unit configured to detect an area including the plurality of feature areas as a tracking area that includes tracking targets, based on a distance between the plurality of feature areas detected by the feature area detecting unit, wherein a trajectory line indicating a trajectory of a tracking target is displayed in a superimposed manner on the video data and wherein, when a part at which lines of the trajectory line displayed in the display area intersect with each other is selected through an operation of the input unit, the reproducing unit performs display to receive selection regarding which of the lines intersecting each other is to be selected, characterized in that the reproducing unit is configured to display a frame selection window if a part at which lines intersect with each other is operated, wherein the frame selection window is displayed to allow a user to select any of frames with dates and times corresponding to the intersecting lines.