Patent ID: 8995793
Filing Date: 2015-03-31
Classification: G06T

Abstract:
1. A method of performing moving object super-resolution on a plurality of images including a moving object, the method comprising: acquiring a target at an initial frame; tracking the target through subsequent N−1 frames, wherein tracking the target through subsequent N−1 frames includes (i) proceeding across the N image frames in pairs of adjacent frames, (ii) for each pair of adjacent frames, performing pair-wise 2D similarity registration, and (iii) aggregating pair-wise motion estimates across N frames, to estimate the motion between each frame and the initial frame; calculating sub-pixel motion estimates of the target across all N frames, wherein the sub-pixel motion estimates indicate how a given pixel in each image frame maps back onto the initial image frame; extracting an image from each of the N frames, wherein each extracted image is roughly centered on the target and is large enough to completely surround the target; computing the Fourier spectrum for the extracted images; calculating a magnitude for spectra resulting from computing the Fourier spectrum, based on the equation: m(u,v)=sqrt(Re(s(u,v)) transforming the calculated magnitude for the spectra to log-polar images based on the equation: LP(logr,t)=m(U(logr,t),V(logr,t)), wherein U(logr,t)=R*exp(logr)*cos(t*dt), V(logr,t)=R*exp(logr)*sin(t*dt), with a radial operating point R, angular delta dt, wherein logr and t are integral indices into a corresponding LP matrix, and wherein if a coordinate (U,V) does not coincide with a known point in m(u,v), then (U,V) is calculated by interpolation; and performing super-resolution using (i) the extracted images following the transforming, and (ii) the sub-pixel motion estimates, to produce a super-resolved image.