METHOD OF MOTION COMPENSATION AND ELASTIC DEFORMATION IN PICTURE SEQUENCES

Abstract: The invention relates to a method of motion compensation and elastic deformation in picture sequences in transmission of moving pictures between a transmitter and a receiver, that is a picture coding method in which the pixel values of the picture are determined using a previous picture. In the transmitter, each picture in the picture sequence is divided into triangles by suitably choosing corner points, and the motion between two successive pictures is estimated such that the motion vectors of all the corner points can be established. Information about the corner points and/or the motion vectors is transmitted from the transmitter to the receiver, in which the motion vectors of the internal points of the triangles are calculated using the three transmitted motion vectors belonging to the respective triangle. The pixel values in the corner points of the triangles and in the internal points of the triangles are calculated using the trasmitted and the calculated motion vectors, respectively. Preferably, the motion vectors of the internal points of the triangles are calculated by interpolation.

Description: TITLE OF INVENTION: METHOD OF MOTION COMPENSATION AND ELASTIC DEFORMATION IN PICTURE SEQUENCES FIELD OF THE INVENTION The present invention relates to a method of motion compensation and elastic deformation in the picture sequences, that is a picture coding method in which the pixel values in a picture are determined using the pre¬ vious picture. It is assumed that the motion between two successive pictures is known, that is the motion vector field is known. The motion may include both translation and deformation. STATE OF THE ART It is previously known to use motion vector fields for picture coding. In this connection, the picture is divided into rectangular blocks. In this division problems may occur with visible squares in the picture sequence because of dis¬ continuities at the edges of the block. According to the present invention this problem is solved by dividing the picture in triangles instead and interpolate the motion field. SUMMARY OF THE INVENTION Thus, the present. invention provides a method of motion compensation and elastic deformation in picture sequences in transmission of moving pictures between a transmitter and a receiver. According to the invention each picture in a pic¬ ture sequence is divided into triangles and the motion be¬ tween two successive pictures is estimated such that the motion vectors in the corner points of the triangles can be determined. Information about the corner points and/or the motion vectors is transmitted from the transmitter to the receiver. In the receiver the motion vectors of the inter¬ nal points of the triangles are calculated using the three transmitted motion vectors associated with the respective triangle. The pixel values of the corner points of the re¬ spective triangles are calculated using the transmitted motion vectors and the previous picture and the internal pixel values are calculated using the calculated motion vectors and the previous picture. Further features of the invention are set forth in detail in the accompanying claims. BRIEF DESCRIPTION OF THE DRAWINGS The drawing is a schematic illustration of two successive pictures in which corresponding triangles have been drawn and the respective motion vectors, in which figure 1. shows translation, figure 2. rotation and figure 3. deformation. The invention is described below in detail. DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT OF THE INVENTION The purpose of the invention is to enable transmission of picture sequences by starting from one picture and only transmit motion vectors. There already exists methods of dividing the pictures in rectangular blocks and of deter¬ mining the motion vectors applying within the blocks . A problem is that square blocks then may become visible in the picture because of discontinuities in the motion vec¬ tor field between adjacent blocks. According to the present invention the picture is divided into triangles .instead. The division may be fixed or may be adapted to the picture in question and the motion therein. When the corner points of each triangle are estab¬ lished the motion vectors in the 'orner points are deter¬ mined relative to the previous picture in the sequence. Motion vectors are assigned to points within each triangle by interpolating the motion vectors in the corner points. Thus, contiguous triangles have the same motion vectors along the whole common side. Thereby no discontinuities occur. The pixel values are obtained from the previous picture using the motion vector fields obtained in this way. Generally, the motion vectors indicate undefined points in the previous picture. The pixel value is then obtained using an interpolation filter, preferably in accordance with our co-pending patent application titled "Method of moving a pixel a subpixel distance". In the figures, various ways of how a triangle can be moved are shown. Figure 1 shows a translation, figure 2 a rotation and figure 3 a deformation, in this case an en¬ largement . Normally, the movement of the triangle is a combination of these three basic types . The co-ordinates of the new triangle can be expressed in matrix form as Y t = Xt + M t where Xt is the co-ordinates of the old triangle, Yt is the new triangle and M t contains the three motion vectors. Any point (x, y) may be expressed using the position vectors of the triangel Xt. Define a triangle having three corner points Create a base of vectors vi, V 2 , V3 using the corner points Then an arbitrary point in the picture plane can be expressed as (x, y) = vi + av2 + v3 For points within the triangle X t the following relations apply 0 < a < 1 and 0 < b < a . For a given point (x, y ) a and b can be calculated with the formulas a = b = (X3- 2 ) (y2-yι) - (y3-y2) ( χ 2- χ ι) A set of positions X may be expressed as X = BX t where each line of X is a position (xi, yi) and Several triangles can be processed at the same time with a matrix Xt containing all the triangle corners in¬ volved. With a number of corners = nc: Then B is modified such that each line has nc positions and the values 1-a , ai-bi and bi are placed in the positions correspondning to the corner point that is to be used. All other positions are zero. A continouos motion vector field in the triangle Y t is obtained if the motion vectors are calculated as M = BM t where the positions in question within the respective triangle are inserted in B. The triangle division of the picture is performed in the transmitter and the corner points of the triangles are established. Thereafter, the motion vectors and the corner points are established. First, a complete picture is trans¬ mitted between the transmitter and receiver. Thereafter, only motion vectors and information about the corner point associated with each motion vector are transmitted. In the receiver the motion vector of every point in the picture is calculated by interpolation of the motion vectors in the corner point (that is by the formula M = BM t ) . Thereafter, all the pixel values can be calculated using the motion vectors and the previous picture. Thus, the present invention provides a method of motion compensation and elastic deformation in picture sequences which solves the above problem with discontinuities between blocks in the picture. The invention is defined in the accompanying claims.

Claims: CLAIMS 1. Method of motion compensation and elastic defor¬ mation in picture sequences in transmission of moving pic- tures between a transmitter and a receiver, characterized in that in the transmitter, each picture in a picture sequence is divided into triangles by suitable choice of corner points, the motion between two successive pictures is estimated, and the motion vectors in all the corner points is established, information about the motion vectors and, if necessary, the corner points is transmitted from the transmitter to the receiver, and in the receiver, the motion vectors of the internal points of the triangles are calculated using the three transmitted motion vectors of the respective triangle, the pixel values of the corner points of the triangles are calculated using the transmitted motion vectors and the previous picture, and the pixel values of the internal points of the tri¬ angles are calculated using the calculated motion vectors and the previous picture. 2. Method according to claim 1, characterized in that the motion vectors of the internal pixels of the triangles are calculated by interpolation.

Inventors: BRUSEWITZ HARALD, BRUSEWITZ, HARALD
Applicants: TELEVERKET
Application year: 1991
Main classification: G06F15
IPC codes: G06T7, H04N5, H04N7