Images of outdoor scenes captured in bad weather suffer from poor contrast. Under bad weather conditions, the light reaching a camera is severely scattered by the atmosphere. The resulting decay in contrast varies across the scene and is exponential in the depths of scene points. Therefore, traditional space invariant image processing techniques are not sufficient to remove weather effects from images. In this paper; we present a fast physics-based method to compute scene structure and hence restore contrast of the scenefiom two or more images taken in bad weather. In contrast to previous techniques, our method does not require any a priori weather-specijk or scene information, and is effective under a wide range of weather conditions including haze, mist, fog and other aerosols. Furtheq our method can be applied to gray-scale, RGB color; multi-spectral and even IR images. We also extend the technique to restore contrast of scenes with moving objects, captured using a video camera. Most outdoor vision applications such as surveillance, target tracking and autonomous navigation require robust detection of image features. Under bad weather conditions, however, the contrast and color of images are drastically degraded. Hence, it is imperative to remove weather effects from images in order to make vision systems more reliable. Unfortunately, the effects of bad weather increase exponentially with the distances of scene points from the sensor. As a result, conventional space invariant filtering techniques fail to adequately remove weather effects from images. Recently, there has been an increased interest in the image processing and vision communities on issues related to imaging under bad weather. Kopeika et a1 [5, 171 de-blur atmospherically degraded images using a weather-predicted atmospheric modulation transfer function, and an a-priori estimate of the distance from which the scene is imaged. Oakley et a1 [ 12, 151 describe a physics based method to restore scene contrast without using predicted weather information. However, they assume that scene depths are known beforehand, and approximate the distribution of radiances in the scene by a single gaussian with known variance. [ll]. Using constraints on scene color changes, they compute complete 3D structure and recover clear day scene colors from two or more bad weather images. However, they assume that the atmospheric scattering properties do nor change with the wavelength of light. This property holds over the visible spectrum only for certain weather conditions such as fog and dense haze. Furthermore, the dichromatic model is ambiguous for scene points whose colors match the color of fog or haze. Polarizing filters have been used widely by photographers to reduce haziness in images. However, polarization filtering alone does not ensure complete removal of haze. Schechner et a1 [ 131 further analyzed 2 or more polarization filtered images to compute scene structure and dehaze images. Another work by Grewe and Brooks [2] uses wavelet based fusion of multiple bad weather images to get a less blurred image. In this paper, we present a physics based method to restore contrast completely from two or more images taken in bad weather. A monochrome atmospheric scattering model that describes how scene intensities are effected by weather conditions is presented. This model is valid in both the visible and near-IR spectra, and for a wide range of weather conditions such as mist, haze, fog and other aerosols. Based on this model, an automatic algorithm to recover complete scene structure from two images taken under different weather conditions is presented. Using the computed structure, contrast is restored from a single image of the scene. We extend our algorithms to handle video and describe a simple heuristic to restore contrasts of moving objects in the scene whose depths are unknown. The entire analysis in this paper is done for monochrome (narrow spectral band) images. However, we show that our methods can be applied to images taken using gray-scale, wide-band RGB, multi-spectral and also narrow-band IR cameras. The effectiveness of these sensors under various weather conditions is discussed. Scattering of light by physical media has been one of the main topics of research in the atmospheric optics and astronomy communities. In general, the exact nature of scattering is highly complex and depends on the types, orientations, sizes and distributions of particles constituting the media, as well as wavelengths, polarization states and directions of the incident light [ 1, 3] . Here, we focus on two models -attenuation and airlight, that form the basis of our work.
Narasimhan et al. REF proposed a method to estimate the depth information by comparing two images of the same scene in different weather conditions.
Removing weather effects from monochrome images
Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001
Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001
Computer Science