Abstract-We propose the concept of a generalized assorted pixel (GAP) camera, which enables the user to capture a single image of a scene and, after the fact, control the tradeoff between spatial resolution, dynamic range and spectral detail. The GAP camera uses a complex array (or mosaic) of color filters. A major problem with using such an array is that the captured image is severely under-sampled for at least some of the filter types. This leads to reconstructed images with strong aliasing. We make four contributions in this paper: 1) we present a comprehensive optimization method to arrive at the spatial and spectral layout of the color filter array of a GAP camera. 2) We develop a novel algorithm for reconstructing the under-sampled channels of the image while minimizing aliasing artifacts. 3) We demonstrate how the user can capture a single image and then control the tradeoff of spatial resolution to generate a variety of images, including monochrome, high dynamic range (HDR) monochrome, RGB, HDR RGB, and multispectral images. 4) Finally, the performance of our GAP camera has been verified using extensive simulations that use multispectral images of real world scenes. A large database of these multispectral images has been made available at http://www1.cs.columbia.edu/ CAVE/projects/gap_camera/ for use by the research community. Index Terms-Assorted pixels, color filter array, color reproduction, demosaicing, dynamic range, multispectral imaging, signal to noise ratio, skin detection, sub-micrometer pixels.
Yasuma et al. REF later proposed a more general pattern, Generalized Assorted Pixel, with the capability to recover monochrome, RGB, high dynamic range (HDR), multi-spectral images while sacrificing spatial resolutions.
Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum
IEEE Transactions on Image Processing
IEEE Transactions on Image Processing
Computer Science Mathematics Medicine