Patent Document ID: 9792668
Application ID: 14981518
Patent Status: 1

Claim One:
1. An apparatus comprising: computer storage comprising a computer-readable storage medium; and a processing device operatively coupled to the computer storage and to reconstruct spatial resolution of an image of a scene captured within a multi-spectral image and a panchromatic image, the multi-spectral image obtained from a multi-spectral image sensor having a color filter array and positioned at a first optical axis, and the panchromatic image obtained from a panchromatic sensor positioned at a second optical axis that is substantially parallel to the first optical axis; wherein, to reconstruct the spatial resolution of the image, the processing device is to: extract a luminosity subcomponent image from the multi-spectral image; upsample the luminosity subcomponent image to an intended scale of a super-resolved image to be produced, to generate a luminosity image; for each pixel of a plurality of pixels of the luminosity image, to produce the super-resolved image: extract a first image patch surrounding the pixel; extract a plurality of second image patches from the panchromatic image such that the plurality of second image patches are each smaller than the first image patch by a ratio of a size of the panchromatic image to a size of the luminosity image; upsample the plurality of second image patches to a scale of the luminosity image, to generate a plurality of upsampled second image patches; match each patch of the plurality of upsampled second image patches to the first image patch; and replace a value of the pixel of the luminosity image with a new pixel value taken from a central pixel of an upsampled second image patch of the plurality of upsampled second images patches that most closely matches the first image patch; and store, in the computer storage, the super-resolved image as a replacement of the image.