A computer-implemented method to encode images, the method comprising: receiving a retargeted sequence of images having a target image resolution, wherein the retargeted sequence of images is retargeted from a source sequence of images having a source image resolution, the source image resolution having a different aspect ratio from the target image resolution; determining at least one non-linear warp function configured to generate a predicted sequence of images having the source image resolution from the retargeted sequence of images having the target image resolution, wherein the at least one non-linear warp function comprises at least one inverse warp specifying a quad in the predicted sequence of images for each pixel of the retargeted sequence of images, wherein the at least one non-linear warp function is encoded by decomposing a parameter domain of the at least one non-linear warp function based on a quincunx resolution pyramid (1002; 1004; 1006) to generate a plurality of spatial layers, each spatial layer comprising a subset of the parameter domain and of the corresponding image domain of the at least one non-linear warp function, wherein the plurality of spatial layers comprises a lower-resolution spatial layer and a higher-resolution spatial layer, wherein the higher-resolution spatial layer is predictively encoded (1104; 1108) based on the lower-resolution spatial layer; determining differences between the predicted sequence of images having the source image resolution and the source sequence of images having the source image resolution by operation of one or more computer processors; and generating a single bitstream by encoding at least three components including: (i) a first component comprising: the received retargeted sequence of images having the target image resolution; (ii) a second component comprising the at least one non-linear warp function; and (iii) a third component comprising the determined differences; wherein the single bitstream is decodable to generate a sequence of images in the target image resolution based on the first component and also decodable to generate a sequence of images in the source image resolution based on the three components. receiving a retargeted sequence of images having a target image resolution, wherein the retargeted sequence of images is retargeted from a source sequence of images having a source image resolution, the source image resolution having a different aspect ratio from the target image resolution; determining at least one non-linear warp function configured to generate a predicted sequence of images having the source image resolution from the retargeted sequence of images having the target image resolution, wherein the at least one non-linear warp function comprises at least one inverse warp specifying a quad in the predicted sequence of images for each pixel of the retargeted sequence of images, wherein the at least one non-linear warp function is encoded by decomposing a parameter domain of the at least one non-linear warp function based on a quincunx resolution pyramid (1002; 1004; 1006) to generate a plurality of spatial layers, each spatial layer comprising a subset of the parameter domain and of the corresponding image domain of the at least one non-linear warp function, wherein the plurality of spatial layers comprises a lower-resolution spatial layer and a higher-resolution spatial layer, wherein the higher-resolution spatial layer is predictively encoded (1104; 1108) based on the lower-resolution spatial layer; determining differences between the predicted sequence of images having the source image resolution and the source sequence of images having the source image resolution by operation of one or more computer processors; and generating a single bitstream by encoding at least three components including: (i) a first component comprising: the received retargeted sequence of images having the target image resolution; (ii) a second component comprising the at least one non-linear warp function; and (iii) a third component comprising the determined differences; (i) a first component comprising: the received retargeted sequence of images having the target image resolution; (ii) a second component comprising the at least one non-linear warp function; and (iii) a third component comprising the determined differences; wherein the single bitstream is decodable to generate a sequence of images in the target image resolution based on the first component and also decodable to generate a sequence of images in the source image resolution based on the three components.