An image processing device comprising: an invalid pixel detection unit that detects a saturated pixel and a black-crushed pixel as invalid pixels from a non-polarized image and a plurality of polarized images for different polarization directions obtained by performing image pickup using a polarization image pickup unit; and a polarization information generation unit that performs processing of generating polarization information on a basis of the non-polarized image and the polarized images, and switches processing of generating the polarization information depending on a detection result of the invalid pixels in the invalid pixel detection unit; wherein: the invalid pixel detection unit detects a pixel having a pixel value larger than a preset saturation detection threshold as the saturated pixel, and detects a pixel having a pixel value smaller than a preset black crushing detection threshold as the black-crushed pixel; the saturation detection threshold and the black crushing detection threshold are set depending on a characteristic of an image acquired by the polarization image pickup unit performing the image pickup; and the black crushing detection threshold is set to be larger than an output minimum value of the polarization image pickup unit by a first level, and the saturation detection threshold is set to be smaller than an output maximum value of the polarization image pickup unit by a second level smaller than the first level. an invalid pixel detection unit that detects a saturated pixel and a black-crushed pixel as invalid pixels from a non-polarized image and a plurality of polarized images for different polarization directions obtained by performing image pickup using a polarization image pickup unit; and a polarization information generation unit that performs processing of generating polarization information on a basis of the non-polarized image and the polarized images, and switches processing of generating the polarization information depending on a detection result of the invalid pixels in the invalid pixel detection unit; wherein: the invalid pixel detection unit detects a pixel having a pixel value larger than a preset saturation detection threshold as the saturated pixel, and detects a pixel having a pixel value smaller than a preset black crushing detection threshold as the black-crushed pixel; the saturation detection threshold and the black crushing detection threshold are set depending on a characteristic of an image acquired by the polarization image pickup unit performing the image pickup; and the black crushing detection threshold is set to be larger than an output minimum value of the polarization image pickup unit by a first level, and the saturation detection threshold is set to be smaller than an output maximum value of the polarization image pickup unit by a second level smaller than the first level. the invalid pixel detection unit detects a pixel having a pixel value larger than a preset saturation detection threshold as the saturated pixel, and detects a pixel having a pixel value smaller than a preset black crushing detection threshold as the black-crushed pixel; the saturation detection threshold and the black crushing detection threshold are set depending on a characteristic of an image acquired by the polarization image pickup unit performing the image pickup; and the black crushing detection threshold is set to be larger than an output minimum value of the polarization image pickup unit by a first level, and the saturation detection threshold is set to be smaller than an output maximum value of the polarization image pickup unit by a second level smaller than the first level.