An image processing apparatus comprising: a composite image generation unit that is configured to perform a process of combining a color image captured from a first viewpoint and a black-and-white image captured from a second viewpoint different from the first viewpoint, to generate a composite image, the color image providing color information, the black-and-white image providing brightness information; a feature amount calculation unit configured to calculate image feature amounts for determining image quality deterioration due to parallax and pixel saturation; a control unit for obtaining current imaging condition information an image quality determination unit configured to determine, based on the image feature amounts and the current imaging condition information, which of the following four types of images has the highest image quality: (a) a color image-based composite image, (b) a black-and-white image-based composite image, (c) the color image, and (d) the black-and-white image, or which of the following two types of images has the highest image quality: (a) the composite image, and (b) the color image, and a display information control unit, wherein information on the result of image quality determination is output to the display information control unit and the display information control unit is configured to perform control such that auxiliary information regarding the composite image is displayed on a display unit, the auxiliary information comprising composite image capturing guide information and a composite image adaptation level indicator being an indicator that indicates a composite image capturing adaptation level regarding the current imaging condition information. a composite image generation unit that is configured to perform a process of combining a color image captured from a first viewpoint and a black-and-white image captured from a second viewpoint different from the first viewpoint, to generate a composite image, the color image providing color information, the black-and-white image providing brightness information; a feature amount calculation unit configured to calculate image feature amounts for determining image quality deterioration due to parallax and pixel saturation; a control unit for obtaining current imaging condition information an image quality determination unit configured to determine, based on the image feature amounts and the current imaging condition information, which of the following four types of images has the highest image quality: (a) a color image-based composite image, (b) a black-and-white image-based composite image, (c) the color image, and (d) the black-and-white image, or (a) a color image-based composite image, (b) a black-and-white image-based composite image, (c) the color image, and (d) the black-and-white image, or which of the following two types of images has the highest image quality: (a) the composite image, and (b) the color image, and (a) the composite image, and (b) the color image, and a display information control unit, wherein information on the result of image quality determination is output to the display information control unit and the display information control unit is configured to perform control such that auxiliary information regarding the composite image is displayed on a display unit, the auxiliary information comprising composite image capturing guide information and a composite image adaptation level indicator being an indicator that indicates a composite image capturing adaptation level regarding the current imaging condition information.