MOTION-COMPENSATED INTERPOLATION

Abstract: A method of motion-compensated interpolation of a picture signal (Pi) having input fields, comprises the steps of providing (ME) motion vectors (D) between a first and a second input field of the picture signal (Pi), and providing (MC1, OC) an interpolated field (Po) on the basis of at least one input field in dependence upon the motion vectors (D). In accordance with the invention, at least one further motion vector (Dmax) is furnished (C2) in addition to each provided motion vector (D), whereby the interpolated field (Po) is furnished (MC1, MC2, OC) in dependence upon both the first-mentioned motion vectors (D) and the further motion vectors (Dmax).

Description: Motion-compensated interpolation. The invention relates to a motion compensated interpolation of picture signals. Many prior art documents show techniques for implementing such a motion-compensated interpolation of picture signals. In pictures resulting from motion- compensated field rate convenors a halo-like artifact is usually visible at the boundary of moving objects. EP-A-O,475,499 discloses a system for field rate conversion in which the interpolated pictures result from just one neighbouring field. The advantage of such an approach is the improved dynamic resolution of the resulting pictures. It is, inter alia, an object of the invention to reduce this local artifact. To this end, a first aspect of the invention provides a method as defined in claim 1. A second aspect of the invention provides an interpolation device as defmed in claim 6. A third aspect of the invention provides a picture signal display apparatus as defmed in claim 7. Advantageous embodiments are defined in the dependent claims. A method of motion-compensated interpolation of a picture signal having input fields, comprises the steps of providing motion vectors between a first and a second input field of the picture signal, and providing an interpolated field on the basis of at least one input field in dependence upon the motion vectors. In accordance with the invention, at least one further motion vector is furnished in addition to each provided motion vector, whereby the interpolated field is furnished in dependence upon both the first-mentioned motion vectors and the further motion vectors. The invention is especially advantageous in motion vector compensated interpolation systems which obtain the interpolated field by a motion vector compensated shift of one field only rather than by a kind of motion vector compensated average of two input fields. It is possible that a motion vector estimated between first and second fields is used to unilaterally shift a third field; such a method could appear to yield advantages with regard to the required amount of memory hardware. In the claims, a field may be a progressive field without interlace. These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter. In the drawing: Fig. 1 schematically illustrates an embodiment of a television display apparatus comprising a picture interpolation device in accordance with the present invention. In the embodiment of Fig. 1, an input picture signal Pi is applied to a motion vector estimator ME which calculates a motion vector D for each block of an array of blocks into which the pictures are divided. An output of the motion vector estimator ME is applied to a first calculation circuit Cl which determines the smallest motion vector Dmin of the set of motion vectors determined for a current block and its adjacent blocks. The output of the motion vector estimator ME is also applied to a second calculation circuit C2 which determines the motion vector Dmax which shows the largest difference to the current motion vector D, among the set of motion vectors determined for the current block and its adjacent blocks. A multiplexer Ml applies the motion vector D or the motion vector Dmin to a first motion-compensated interpolation circuit MCI which determines a first picture signal PI on the basis of the input picture signal Pi. A multiplexer M2 applies the motion vector Dmax or the motion vector Dmin to a second motion-compensated interpolation circuit MC2 which determines a second picture signal P2 on the basis of the input picture signal Pi. The multiplexers Ml and M2 are controlled by a comparator Cp which determines whether the motion vector Dmin falls below a threshold Th. An output circuit OC furnishes an output picture signal Po on the basis of the picture signals PI and P2. The input picture signal Pi and the output picture signal Po are interleaved by an interleaving circuit IL and displayed on a monitor M. The invention deals with the following problem. In pictures resulting from motion-compensated field rate convenors a halo-like artifact is usually visible at the boundary of moving objects, i.e. near discontinuities in the velocity plane. It is an object of the present invention to reduce this local artifact, without introducing global disadvantages. To this end, in one embodiment of the invention, the picture is interpolated with two motion vectors for every location. The first vector D, is the one calculated for the current position whereas the other is the most extremely differing one, Dmax, available in a predefined neighbourhood of the current position. An example of a possible neighbourhood is the area of 3 by 3 blocks as used for a block-matching motion estimation algorithm. The effect is that in case of a discontinuity in the velocity field every position is at least compensated with the correct motion vector (and also with the wrong motion vector). Consequently, the artifact has been reduced with 3 dB. Disadvantage of the method is that the area of the halo is increased, but experiments indicate that the overall result is subjectively more attractive. Obviously, the method does not introduce any defects in areas with a homogeneous motion vector field. An alternative for the present proposal would be to apply a larger number of motion vectors (taken from a neighbourhood of the current position) instead of using the most extreme neighbouring motion vector. This however would cost more access to the compensation device (memory). In a sophistication of the method, it is checked whether one of the motion vectors (the current one or any of the neighbouring motion vectors) is close to the zero vector 0, i.e. j Din j < threshold (vector length or absolute sum of vector components). If this is the case, only one motion vector is used in the motion-compensated interpolation, preferably the smallest, i.e. Din, which is closest to the zero vector 0. The background of this sophistication is, that stationary parts of the picture (particularly critical stationary parts such as subtitles) are not degraded by the use of more than one motion vector. Fig. 1 illustrates the present invention including this sophistication. It will be clear that although the figure shows two separate motion compensators MC and MC, it will generally be possible to share the memory devices required for the shifting operation. Also, the memory devices used for the motion- compensated shift or interpolation may be shared with the motion vector estimator ME. It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. The output circuit could be a median filter based circuit which determines the median of the pixel from the input picture Pi and the pictures P and P. Instead of taking the vector Max showing the largest difference with regard to the current motion vector D, it is possible to take some other suitably chosen motion vector, for example, the vector which was optimal for the block located at the left upper corner point of the current block. A block does not necessarily need to have a square shape; any other form is possible.

Claims: laims' 1. A method of motion-compensated interpolation of a picture signal (Pi) having input fields, the method comprising the steps of: providing (ME) motion vectors (D) between a first and a second input field of said picture signal (Pi); and providing (MCI, OC) an interpolated field (Po) on the basis of at least one input field in dependence upon said motion vectors (D); characterized by the steps of: providing (C2) in addition to each motion vector (D), at least one further motion vector (DMax); wherein said interpolated field (Po) is provided (MCI, MC2, OC) in dependence upon both said first-mentioned motion vectors (D) and said further motion vectors (Dmax). 2. A method as claimed in claim 1, wherein said further motion vector (Dmax) is taken to be different from the corresponding first-mentioned motion vector (D). 3. A method as claimed in claim 2, wherein said further motion vector (Dmax) is selected from among a set of motion vectors determined for a current block of pixel elements for which the first-mentioned motion vector (D) has been provided, and its adjacent blocks of pixel elements, wherein the further motion vector (Dmax) shows the largest difference to the current motion vector (D). 4. A method as claimed in claim 1, further comprising the steps of providing (Cl) in addition to each motion vector (D) corresponding to a given part of a picture, a smallest motion vector (Dmin) taken from the group of said first-mentioned motion vector (D) and at least one motion vector corresponding to at least one neighbouring part of said picture; wherein said interpolated field (Po) is provided (Ml , M2, MCI , MC2, OC) in dependence upon said first-mentioned motion vectors (D), said further motion vectors (Dmax), and said smallest motion vectors (Dmin). 5. A method as claimed in claim 4, wherein if the magnitude of said smallest motion vector (Dmin) falls below a given threshold (Th), said given part of the picture is interpolated in dependence upon said smallest motion vector only (Dmin). 6. A device for motion-compensated interpolation of a picture signal (Pi) having input fields, the device comprising: means (ME) for providing motion vectors (D) between a first and a second input field of said picture signal (Pi); and means (MCI) for providing an interpolated field (Po) on the basis of at least one input field in dependence upon said motion vectors (D); characterized by: means (C2) for providing in addition to each motion vector (D), at least one further motion vector (Dmax); wherein said interpolated field (Po) is provided (MCI, MC2, OC) in dependence upon both said first-mentioned motion vectors (D) and said further motion vectors (Dmax). 7. A picture signal display apparatus, comprising: means for receiving a picture signal (Pi) having input fields; a device as claimed in claim 6, for providing an interpolated field (Po) in response to said input fields: means (IL) for interleaving said input fields and said interpolated field (Po), to obtain an interleaved picture signal; and means (M) for displaying said interleaved picture signal.

Inventors: BIEZEN PAUL WILLEM ALBERT CORN, DE HAAN GERARD, BIEZEN, PAUL, WILLEM, ALBERT, CORNELIS, DE HAAN, GERARD
Applicants: PHILIPS ELECTRONICS NV, PHILIPS NORDEN AB, PHILIPS ELECTRONICS N.V.
Application year: 1996
Main classification: H04N5
IPC codes: H04N5, H04N7