Television transmission system including a hybrid encoding circuit

Abstract: In a television transmission system each picture is subjected to a number of picture transforms for limiting the bit rate. In each picture transform the picture is partitioned into sub-pictures of a given size. The sub-picture size is different for the different picture transforms. Each sub-picture is converted into a limited number of predetermined coefficients by means of a sub-picture transform. This number is related to the sub-picture size. With the matrix of coefficients thus obtained for each picture an approximation of the original picture is made by means of an inverse transform and this approximation is subjecrted to one of the said forward transforms. The matrix of coefficients now obtained is subtracted from this matrix of coefficient which is obtained by subjecting the original picture to the same forward transform.

Description: A. Background of the invention A(1) Field of the invention The invention generally relates to a television transmission system for transmitting television pictures in a digital format from an encoding station to a decoding station via some transmission medium. More particularly the invention relates to a television transmission system in which generally picture coding and particularly transform coding are used to limit the bit rate. Such a television transmission system may form part of a television broadcasting system, in which case the encoding station forms part of a broadcasting transmitter and each TV receiver is provided with a decoding station. In this case the transmission medium is the atmosphere. Such a transmission system may also form part of a video recorder in which case the transmission medium is a videotape. A(2) Description of the prior art In picture coding it is generally common practice to consider a picture as a matrix of E₁xE₂ pixels, each with a given colour. As is known, a colour is obtained by a linear combination of three so-called component signals such as Y, U, V or R, G, B. The following applies to each of the component signals separately. The value which a given component signal has for a given pixel will be referred to as pixel value. When digitising such a picture, a number is assigned to each pixel. This may indicate the pixel value itself, or, for example the difference between the pixel values of two contiguous pixels. In the first mentioned case a digital picture is in a canonical form, shortly called a canonical picture. In a 625-line TV picture the visible part of the picture comprises 576 lines and each line comprises 720 pixels. If the considered pixel value for each pixel is represented by 8 bits, approximately 3.10⁶ bits are required for representing the canonical picture. With 25 such pictures per second this results in a bit rate of approximately 75.10⁶ bits/sec. In practice this is found to be unacceptably high. The object of the encoding station is to convert the canonical picture into a non-canonical picture which can be represented with a considerably smaller number of bits. Different methods are known for the said conversion, for example the above-mentioned method in which a number is assigned to each pixel indicating the difference between the pixel values of two contiguous pixels. This method is known under the name of Differential Pulscode Modulation, abbreviated DPCM. In another method, which is known under the name of transform coding, the canonical picture is subjected to a forward transform. To this end the picture to be transformed is more particularly partitioned into sub-pictures having a size of N p pixels. Each sub-picture is subsequently converted by means of a two-dimensional transform into N p coeffficients. With the aid of such a picture transform a picture is thus converted into a matrix of E₁E₂ coefficients. It is to be noted that the sub-pictures are usually square-shaped in practice. A reduction of the number of bits which must be transmitted per picture is now realised by transmitting only a limited number of coefficients. This is only possible if the coefficients are uncorrelated. The transform chosen is closely related to the extent to which this object is achieved. In this connection the Karhunen-Loeve transform is found to be optimum (see for example Reference 1, pages 259-264). Nowadays Discrete Cosine Transform, abbreviated DCT is generally considered the best alternative (see Reference 1). The total number of coefficients which is transmitted in this way for each picture forms a matrix and the number of coefficients in this matrix is referred to as the order of the picture transform. In practice it is found that the number of coefficients qualifying for transmission may be greatly different from picture to picture. To prevent the allowed bit rate from being exceeded, the coefficients to be transmitted are quantised in a coarser manner as more coefficients are qualified for transmission. In this case the picture quality is, however, influenced detrimentally. B. Object and summary of the invention It is the object of the invention to provide a television transmission system of the type described above in which a better picture quality is realised while using a comparable bit rate. According to the invention the encoding station uses a transcoding method, characterized by: a) subjecting the original pictures to a plurality of forward transforms (T(i) (i=0,1,2,...,M) of different order R(i), each such forward transform partitioning the original picture applied thereto into a number N(i) of sub-pictures of E i xE i pixels each and calculating for each such sub-picture a group G(i) consisting of C(i) predetermined coefficients, the product of the numbers N(i) and C(i) constituting the said order R(i), whereby R(o) is the highest order; b) subtracting from each coefficient of the group G(i) a corresponding coefficient of a group P(i) consisting of C(i) prediction coefficients to produce a group D(i) of C(i) difference coefficients (v i ); c) performing a quantisation operation Q i on the difference coefficients of the group D(i) to produce a group QD(i) of C(i) quantized difference coefficients (v and i ); d) formatting the thus obtained quantized difference coefficients in a transmission format; e) subjecting the group G(i) of coefficients to an inverse transform S(i) to generate a prediction sub-picture of E i xE i pixels; f) subjecting the prediction sub-pictures to the forward transform T(i-1) of order R(i-1) to generate the group P(i-1) of prediction coefficients; and the decoding station uses an inverse transcoding method, characterized by: a) deformatting the received transmission format to produce groups QD(i) of C(i) quantized difference coefficients (v and i ); b) subjecting an inverse quantization operation Q⁻¹ i on the group QD(i) of quantized difference coefficients to produce a group D(i,i) of de-quantized difference coefficients; c) performing an inverse transform S(i-k) on a group D(i,i-k) of difference coefficients to produce an auxiliary difference sub-pictures to a forward transform (T(i-1-k) of order R(i-1-k) to produce a new group D(i,i-k-1) of auxiliary difference coefficients; d) repeating for each value of i step b for k=0 to k=i-1 to produce group D(i,o) of difference coefficients; e) furnishing the sum of all groups D(0,0), D(1,0), ..., D(M,0) of difference coefficients. C. References 1. Digital Image Processing; W.K. Pratt; John Wiley and Sons. 2. Television transmission system for transmitting basic picture weighting factors; J.B.O.S. Martens European Patent Application EP-A-0 340 859, published on 08 November 1989 (PHN 12.554) D. Explanation of the invention D(1) Brief description of the Figures Fig. 1 shows diagrammatically a video recorder provided with the television transmission system according to the invention, Fig. 2 shows a transcoding circuit for use in the television transmission system shown in Fig. 1, Fig. 3 shows an inverse transcoding circuit for use in the television transmission system shown in Fig. 1, Fig. 4 shows another embodiment of a transcoding circuit, Fig. 5 shows another embodiment of an inverse transcoding circuit. D(2) General structure of a television transmission system Fig. 1 shows diagrammatically a video recorder provided with the television transmission system according to the invention. This television transmission system comprises an encoding station A and a decoding station B. The encoding station A has an input A0 for receiving picture signals s(t) which are supplied by a picture signal source PS, for example a video camera. The output A1 of this encoding station is connected via a modulation circuit MOD to a write head C1 with which the processed analog picture signal s(t) can be recorded on a magnetic tape TP. To regain the original picture signal, the input B0 of the decoding station B is connected to a read head C2 via a demodulator circuit MOD⁻¹. This read head C2 converts the information recorded on the magnetic tape into electric signals. This decoding station B supplies from its output B1 an analog picture signal s'(t) which can be applied to a monitor M. In the encoding station A the analog picture signal s(t) is sampled in an analog-to-digital converter 1 at a suitably chosen sampling frequency f s of, for example 13.5 MHz and the samples s(n) thus obtained, hereinafter referred to as pixel values, are coded in, for example 8-bit PCM words. These amplitude-discrete pixel values are subsequently applied to a transcoding circuit 2 supplying a bit flow z(j). In the decoding station B the signal supplied by the read head C2 is converted in the demodulator circuit MOD⁻¹ into a bit flow z'(j). This bit flow is converted by an inverse transcoding circuit 3 into a series of picture signal samples s'(n). They are in their turn converted by a digital-to-analog converter into an analog picture signal s'(t) which can be displayed on the monitor M and which is a good approximation of the original signal s(t) supplied by the picture signal source PS. D(3) The transcoding circuit An embodiment of the transcoding circuit 2 is shown in Fig. 2. It comprises four forward transform circuits 20(.) each receiving the picture signal samples s(n) and each subjecting a picture to a two-dimensional transform T(.). Each forward transform circuit transforms a picture into a matrix of coefficients. As already noted, the picture in such a transform is partitioned into overlapping or non-overlapping sub-pictures of N x N pixels and each sub-picture is converted into a block of coefficients qualified for transmission to a decoding station. In each of these transform circuits it is previously determined which coefficients will be transmitted. The product of this number of coefficients and the number of sub-pictures in which the picture is partitioned is referred to as the order of transform. It is different for the different transforms T(.). This can be realised by choosing the sub-pictures for all transforms T(.) equally large and by having the number of coefficients for transmission reduced by an increasing index i of the transform T(i). However, for successive transforms T(i) sub-pictures are preferably chosen with an increasing number of pixels, for example 2 i x 2 i and the number of coefficients for transmission is chosen to be such that the order of the transform T(i) decreases with an increasing value of its index i. More particularly transform circuit 20(0) will then supply the original picture; transform circuit 20(1) will supply only the d.c. coefficient, for example for each sub-picture of 2 x 2 pixels; transform circuit 20(2) will supply an a.c. coefficient in addition to the d.c. coefficient, for example for each sub-picture of 4 x 4 pixels and the same could apply to the transform circuit 20(3) in which each picture is partitioned into sub-pictures of 8 x 8 pixels. The coefficients of the transform T(i) assigned for transmission are applied to a difference producer 21(i) which receives a corresponding prediction coefficient for each coefficient in the matrix. The difference coefficients which are obtained thereby and which each time form part of a difference coefficient matrix are applied to a quantising circuit 22(i) which subjects the presented difference coefficients to a quantising operation Q i . The quantised difference coefficients v and i thus obtained are applied to a multiplex circuit 23 which supplies the bit flow z(j). The prediction coefficients for a difference producer 21(i) are obtained by performing an inverse transform S(i+1) in an inverse transform circuit 24(i+1) on the coefficients of the forward transform T(i+1). Due to this inverse transform S(i+1) pixel values s and i (n) are obtained which are an approximation of the original picture.In a forward transform circuit 25(i+1) the picture which is represented by the pixel values s and i (n) is subjected to the forward transform T(i). As a transform T(i) the two-dimensional Discrete Cosine Transform or any other transform can be used, but preferably the transform described in Reference 2 because this transform only calculates the desired coefficients. An embodiment of an inverse transcoding circuit is shown in Fig. 3. It comprises a demultiplex circuit 30 receiving the bit flow z'(j) and supplying the quantised difference coefficients v and i at its outputs. These coefficients are subjected to a recoding Q i ⁻¹ in a recoding circuit 31(i). This recoding is inverse to the quantisation Q i which is performed by the quantising circuit 22(i) in the encoding station. This recoding circuit 31(i) more or less supplies the original difference coefficients v i which are applied via a channel 32(i) to an input of an adder circuit 33 which consists of three summing devices in this case. Each of these circuits converts the difference coefficients v i applied thereto into a matrix of E₁ x E₂ auxiliary coefficients which matrixes are added in adder circuit 32. More particularly the difference coefficients v o are directly applied to the adder circuit 33, the difference coefficients v i are applied via a cascade arrangement of an inverse transform circuit 34(1) and a forward transform circuit 35(1). The difference coefficients v₂ are applied to the adder circuit via a cascade arrangement of two inverse transform circuits 34(2) and 36(1) and two forward transform circuits 35(2) and 37(1). The difference coefficients v₃ are applied to the adder circuit 33 via a cascade arrangement of three inverse transform circuits 34(3), 36(2), 38(1) and three forward transform circuits 35(3), 37(2), 39(1). In the forward transform circuits 35(.) the same forward transform T(0) is performed as in the forward transform circuit 20(0) in transcoding circuit 2 (see Fig. 2). In a corresponding manner it holds that in the forward transform circuits 37(.) the same forward transform T(1) is performed as in the forward transform circuit 20(1). In the forward transform circuit 39(1) the same forward transform T(2) is performed as in the forward transform circuit 20(3). In the inverse transform circuit 34(.) the same inverse transform S(1) is performed as in the inverse transform circuit 24(1) (see Fig. 1). In the inverse transform circuit 36(.) the same inverse transform S(2) is performed as in the inverse transform circuit 24(2) and in the inverse transform circuit 38(1) the same inverse transform S(3) is performed as in the transform circuit 24(3). Since T(0) represents a forward transform performed on sub-pictures of 1 x 1 pixels, a forward transform circuit with such a forward transform supplies the picture presented to it in an unchanged form at its output. This means that the adder circuit 33 adds a number of difference pictures, in this case four, which results in a good approximation of the original picture. D(4) Some alternative embodiments Fig. 4 shows another embodiment of the transcoding circuit 2. It differs from that shown in Fig. 2 in that the prediction coefficients are now derived from the quantised difference coefficients. To this end summing devices 26(i) are present in this embodiment which receive the quantised difference coefficients v and i supplied by the quantising device 22(i) and those prediction coefficients which are also applied to the difference producer 21(i). Another embodiment of the inverse transcoding circuit 3 is shown in Fig. 5. In contrast to the embodiment shown in Fig. 3 this inverse transcoding circuit only comprises one channel which has the same structure as channel 32(3) shown in Fig. 3. Furthermore the summing devices which at first jointly constituted the adder circuit 33 are distributed over this channel. More particularly a summing device 40(i) is incorporated between the output of a forward transform circuit with forward transform T(i) and the subsequent inverse transform circuit with inverse transform S(i), which summing device receives the difference coefficients v i supplied by the recoding circuit 31(i). D(5) General remarks In the transcoding circuits shown in Figs. 2 and 4 the matrixes of difference coefficients supplied by each difference producer 21(.) are transmitted to the decoding station. In practice it is found to be sufficient if only a limited number of such matrixes of difference coefficients is transmitted. Notably the matrix supplied by difference producer 21(0) will generally not have to be transmitted in practice. This matrix notably represents the difference between the original picture and a first approximation thereof. It is to be noted that due to the specific property of the forward transform T(0) the forward transform circuits 20(0), 25(1) and 35(.) may in principle be replaced by through-connections. In the embodiments described it has been assumed that a separate circuit is provided for performing the inverse transform S(i+1) and for performing the forward transform T(i). However, it will be evident that this is not always necessary. Under many circumstances it is found to be possible to design a circuit which directly supplies the coefficients supplied by the forward transform T(i). It has also been assumed hereinbefore that the performed transforms are two-dimensional. However, they may also be one-dimensional, or even three-dimensional.

Claims: A method for the transmission of pictures comprised of E₁xE₂ pixels, characterized by a) subjecting the original pictures to a plurality of forward transforms T(i) (i=0,1,2,...,M) of different order R(i), each such forward transform partitioning the original picture applied thereto into a number N(i) of sub-pictures of E i xE i pixels each and calculating for each such sub-picture a group G(i) consisting of C(i) predetermined coefficients, the product of the numbers N(i) and C(i) constituting the said order R(i), whereby R(o) is the highest order; b) subtracting from each coefficient of the group G(i) a corresponding coefficient of a group P(i) consisting of C(i) prediction coefficients to produce a group D(i) of C(i) difference coefficients (v i ); c) performing a quantisation operation Q i on the difference coefficients of the group D(i) to produce a group QD(i) of C(i) quantized difference coefficients (v and i ); d) formatting the thus obtained quantized difference coefficients in a transmission format; e) subjecting the group G(i) of coefficients to an inverse transform S(i) to generate a prediction sub-picture of E i xE i pixels; f) subjecting the prediction sub-pictures to the forward transform T(i-1) of order R(i-1) to generate the group P(i-1) of prediction coefficients. A method for the transmission of pictures comprising of E₁xE₂ pixels, characterized by: a) subjecting the original picture to a plurality of forward transforms T(i) (i=0,1,2,...M) of different order R(i) each such forward transform partitioning the original picture into a number N(i) of sub-pictures of E i xE i pixels each, and calculating for each such sub-picture a group G(i) consisting of C(i) predetermined coefficients, the product of the numbers N(i) and C(i) constituting the said order R(i), whereby R(o) is the highest order; b) subtracting from each coefficient of the group G(i) a corresponding coefficient of a group P(i) consisting of C(i) prediction coefficients to produce a group D(i) of C(i) difference coefficients (v i ); c) performing a quantization operation Q i on the difference coefficients of the group D(i) to produce a group QD(i) of C(i) quantized difference coefficients (v and i ); d) formatting the thus obtained quantized difference coefficients in a transmission format; e) adding to each quantized difference coefficient of the group QD(i) a prediction coefficient of the group P(i) to produce a group AU(i) of C(i) auxiliary coefficients; f) subjecting the group AU(i) of auxiliary coefficients to an inverse transform S(i) to generate a prediction sub-picture of E i xE i pixels; g) subjecting the prediction sub-pictures to the forward transform T(i-1) of order R(i-1) to generate the group P(i-1) of prediction coefficients. A method as claimed in Claim 1 or 2, characterized in that the partitioning of the pictures performed by forward transform T(i) results in sub-pictures of 2 i x2 i pixels each. A method for reconstructing pictures transmitted with the method as claimed in Claims 1 or 2 characterized by: a) deformatting the received transmission format to produce groups QD(i) of C(i) quantized difference coefficients (v and i ); b) subjecting an inverse quantization operation Q⁻¹ i on the group QD(i) of quantized difference coefficients to produce a group D(i,i) of de-quantized difference coefficients; c) performing an inverse transform S(i-k) on a group D(i, i-k) of difference coefficients to produce an auxiliary difference sub-picture and subjecting the thus obtained auxiliary difference sub-pictures to a forward transform T(i-1-k) of order R(i-1-k) to produce a new group D(i, i-k-1) of auxiliary difference coefficients; d) repeating for each value of i step b for k=0 to k=i-1 to produce group D(i,o) of difference coefficients; e) furnishing the sum of all groups D(0,0), D(1,0), ..., D(M,0) of difference coefficients.

Inventors: MARTENS JEAN BERNARD OSKAR SUZ, MARTENS, JEAN BERNARD OSKAR SUZANNA
Applicants: PHILIPS NV, N.V. PHILIPS' GLOEILAMPENFABRIEKEN
Application year: 1989
Main classification: H04N7
IPC codes: H04N1, H04N5, H04N7