A spatial scalability method of generating a motion map at a second level of resolution in a hierarchy based on a motion map at a first level of resolution and on a current image of a video signal that is to be encoded at multiple different levels of resolution in a hierarchy, said motion map providing motion information associated to the current image of said video signal, the method comprising: selecting a pixel from a rendition of the motion map at the first level of resolution; subdividing the selected pixel at the first level of resolution into multiple sub-pixels, the multiple sub-pixels being at the second level of resolution in the hierarchy for the motion map, the second level of resolution higher than the first level of resolution; and based at least in part on motion information assigned to said selected pixel in the motion map at the first level of resolution, generating respective motion information for each of the multiple sub-pixels at the second level of resolution of the motion map, characterized in that said step of generating motion information is further based on color settings of pixels of the current image of said video signal, wherein a motion vector (X i) of the motion information at the second level of resolution of the motion map is determined by averaging motion vectors at the first level of resolution that are weighted by weighting each of the motion vectors (W j) at the first level of resolution with a value that is a function of the difference between color settings of the pixel corresponding to that motion vector in the lower resolution current image and the color settings of an estimated sub-pixel in the higher resolution image corresponding to the motion vector (X i) of the motion information at the second level of resolution that is being determined, whereby the estimated sub-pixel is obtained based on color settings of a reference image. selecting a pixel from a rendition of the motion map at the first level of resolution; subdividing the selected pixel at the first level of resolution into multiple sub-pixels, the multiple sub-pixels being at the second level of resolution in the hierarchy for the motion map, the second level of resolution higher than the first level of resolution; and based at least in part on motion information assigned to said selected pixel in the motion map at the first level of resolution, generating respective motion information for each of the multiple sub-pixels at the second level of resolution of the motion map, characterized in that said step of generating motion information is further based on color settings of pixels of the current image of said video signal, wherein a motion vector (X i) of the motion information at the second level of resolution of the motion map is determined by averaging motion vectors at the first level of resolution that are weighted by weighting each of the motion vectors (W j) at the first level of resolution with a value that is a function of the difference between color settings of the pixel corresponding to that motion vector in the lower resolution current image and the color settings of an estimated sub-pixel in the higher resolution image corresponding to the motion vector (X i) of the motion information at the second level of resolution that is being determined, whereby the estimated sub-pixel is obtained based on color settings of a reference image.