An image processing apparatus including: an image inputting unit configured to input a plurality of medical images captured serially in time order; an image dividing unit configured to divide a medical image into a plurality of areas; a feature value calculating unit configured to calculate a plurality of feature values (μgst, μbst) according to a color of at least one object included in the medical image and a plurality of feature values (CVrst, CVgst, CVbst) according to a texture of the at least one object in each of the plurality of areas of the medical image; an area division unit configured to identify and classify which class of a plurality of predetermined first classes each of the plurality areas belongs to based on the feature values (μgst, μbst, CVrst, CVgst, CVbst) calculated by the feature value calculating unit, characterized in that the image processing apparatus further comprises: a division determination value calculating unit configured to calculate for each image a plurality of proportion values, each proportion value representing the total number of areas classified in one of said predetermined first classes to the total number of areas in the image based on the classification result obtained by the area division unit; an image classifying unit configured to classify each image into a second class of predetermined organ classes based on the proportion values calculated by the division determination value calculating unit and a corresponding predetermined threshold relating to the proportion, thereby identifying an organ whose image is captured in the medical image; and an identification result displaying unit configured to display an identification result obtained by the image classifying unit. an image inputting unit configured to input a plurality of medical images captured serially in time order; an image dividing unit configured to divide a medical image into a plurality of areas; a feature value calculating unit configured to calculate a plurality of feature values (μgst, μbst) according to a color of at least one object included in the medical image and a plurality of feature values (CVrst, CVgst, CVbst) according to a texture of the at least one object in each of the plurality of areas of the medical image; an area division unit configured to identify and classify which class of a plurality of predetermined first classes each of the plurality areas belongs to based on the feature values (μgst, μbst, CVrst, CVgst, CVbst) calculated by the feature value calculating unit, a division determination value calculating unit configured to calculate for each image a plurality of proportion values, each proportion value representing the total number of areas classified in one of said predetermined first classes to the total number of areas in the image based on the classification result obtained by the area division unit; an image classifying unit configured to classify each image into a second class of predetermined organ classes based on the proportion values calculated by the division determination value calculating unit and a corresponding predetermined threshold relating to the proportion, thereby identifying an organ whose image is captured in the medical image; and an identification result displaying unit configured to display an identification result obtained by the image classifying unit.