Patent ID: 9258518
Filing Date: 2016-02-09
CPC Classification: G06T,H04N

Claim Text:
1. A method for performing super-resolution on an input video frame sequence having first spatial and a first temporal resolution, comprising: temporally interpolating frames of the input video frame sequence, wherein temporally interpolated frames are obtained; spatially interpolating frames of the input video frame sequence and the temporally interpolated frames, wherein spatial and temporal high-resolution, low-frequency frames are generated that have a second spatial resolution being higher than the first spatial resolution and a second temporal resolution being higher than the first temporal resolution; performing cross-frame spatial high-frequency extrapolation on video frames of the input sequence, wherein a spatial high-frequency synthesis is applied using patches of the input sequence, and wherein high-resolution, high-frequency spatial frames are generated that have the second spatial resolution and second temporal resolution, wherein a first group of spatial high-resolution high-frequency frames having temporally coincident input video frames are synthesized from their respective temporally coincident input video frame, and wherein a second group of spatial high-resolution high-frequency frames not having a temporally coincident input video frame are synthesized from input video frames that are temporally coincident with adjacent frames that belong to the first group; and fusing the spatial and temporal high-resolution, low-frequency frames and the spatial high-resolution, high-frequency frames, wherein a spatio-temporally super-resolved video sequence is obtained.