A video signal processing apparatus, comprising: an input unit, which is configured to be input "n" video frames, where n is an integer equal to or greater than 2; and a video signal processor unit configured to produce video frames having a number of pixels larger than the number of pixels of the input video frames by: estimating sampling phase differences between video data of an input video frame designated to be a reference and the respective video data of the other input video frames, and by performing motion compensation on the video data of each of the input video frames using information of said sampling phase differences; characterised in that the apparatus further comprises: "m" resolution converter units (2001, 2005), where m is an integer equal to or greater than 2, within the video signal processor unit, each of which is configured to have resolution converting characteristics differing from each other depending on a direction thereof, and to compose the input video frames, thereby producing output frames with an increased number of pixels; and a mixer unit, which is configured to obtain output video frame by mixing the output results of said "m" resolution converter units (2001, 2005), wherein each of said "m" resolution converter units (2001, 2005) increases (103, 104) the number of pixels of the input video frames, phase shifts (196, 108) said video frames having increased number of pixels by a phase shift of π/2 in the frequency domain into directions different from each other, and adds said phase shifted video frames with the video frames having increased number of pixels before phase shifting, thereby producing the output video frames; and wherein said "m" resolution converter units include a first resolution converter unit as a horizontal resolution converter unit, a second resolution converter unit as a vertical resolution converter unit, a third resolution converter unit as a resolution converter unit in an oblique, lower right, direction, and a fourth resolution converter unit as a resolution converter unit in an oblique, upper right, direction. an input unit, which is configured to be input "n" video frames, where n is an integer equal to or greater than 2; and a video signal processor unit configured to produce video frames having a number of pixels larger than the number of pixels of the input video frames by: estimating sampling phase differences between video data of an input video frame designated to be a reference and the respective video data of the other input video frames, and by performing motion compensation on the video data of each of the input video frames using information of said sampling phase differences; characterised in that the apparatus further comprises: "m" resolution converter units (2001, 2005), where m is an integer equal to or greater than 2, within the video signal processor unit, each of which is configured to have resolution converting characteristics differing from each other depending on a direction thereof, and to compose the input video frames, thereby producing output frames with an increased number of pixels; and a mixer unit, which is configured to obtain output video frame by mixing the output results of said "m" resolution converter units (2001, 2005), estimating sampling phase differences between video data of an input video frame designated to be a reference and the respective video data of the other input video frames, and by performing motion compensation on the video data of each of the input video frames using information of said sampling phase differences; characterised in that the apparatus further comprises: "m" resolution converter units (2001, 2005), where m is an integer equal to or greater than 2, within the video signal processor unit, each of which is configured to have resolution converting characteristics differing from each other depending on a direction thereof, and to compose the input video frames, thereby producing output frames with an increased number of pixels; and a mixer unit, which is configured to obtain output video frame by mixing the output results of said "m" resolution converter units (2001, 2005), wherein each of said "m" resolution converter units (2001, 2005) increases (103, 104) the number of pixels of the input video frames, phase shifts (196, 108) said video frames having increased number of pixels by a phase shift of π/2 in the frequency domain into directions different from each other, and adds said phase shifted video frames with the video frames having increased number of pixels before phase shifting, thereby producing the output video frames; and wherein said "m" resolution converter units include a first resolution converter unit as a horizontal resolution converter unit, a second resolution converter unit as a vertical resolution converter unit, a third resolution converter unit as a resolution converter unit in an oblique, lower right, direction, and a fourth resolution converter unit as a resolution converter unit in an oblique, upper right, direction.