Patent Description:
To achieve high compression efficiency, image and video coding schemes usually employ prediction and transform to leverage spatial and temporal redundancy in the video content. Generally, intra or inter prediction is used to exploit the intra or inter frame correlation, then the differences between the original image and the predicted image, often denoted as prediction errors or prediction residuals, are transformed, quantized and entropy coded. To reconstruct the video, the compressed data is decoded by inverse processes corresponding to the prediction, transform, quantization and entropy coding.

During various operations in a video compression system, the video data may exceed the data range used to represent the video data. To avoid possible data inversion, for example, a high value exceeding the range of an <NUM>-bit representation may be inadvertently treated as a low value if only the lower eight bits are retained, the video data is usually clipped to a proper range.

A method for adaptive clipping, where clipping bounds are determined from the original signal characteristics and are encoded in the bitstream, is disclosed in <NPL>.

The invention is as defined in the appended independent claims. Advantageous refinements are subject matter of the dependent claims.

According to a general aspect of at least one embodiment, a method for processing video data is presented, comprising: accessing a video signal having a first color component, a second color component, and a third color component in a first color space, wherein the first color component is a luma component, and the second and third color components are chroma components, and wherein the first color component is weakly correlated with the second and third color components; determining parameters for transforming and adaptive clipping bounds; encoding the parameters for transforming; transforming the second color component and the third color component into a transformed second color component and a transformed third color component in a second color space, responsive to the parameters for transforming, wherein the transforming is based on PCA (Principal Component Analysis); clipping, at an encoder, sample values of the transformed second color component and the transformed third color component, responsive to the adaptive clipping bounds; inverse transforming the clipped sample values of the transformed second color component and the transformed third color component; and clipping, at the encoder, sample values of the first color component in the first color space.

According to another general aspect of at least one embodiment, a method for processing video data is presented, comprising: accessing a video signal having a first color component, a second color component, and a third color component in a first color space, wherein the first color component is a luma component, and the second and third color components are chroma components, and wherein the first color component is weakly correlated with the second and third color components; decoding parameters for transforming and adaptive clipping bounds; transforming the second color component and the third color component into a transformed second color component and a transformed third color component in a second color space, responsive to the parameters for transforming, wherein the transforming is based on PCA (Principal Component Analysis); clipping, at a decoder, sample values of the transformed second color component and the transformed third color component, responsive to the adaptive clipping bounds; inverse transforming the clipped sample values of the transformed second color component and the transformed third color component; and clipping, at the decoder, sample values of the first color component in the first color space.

According to another general aspect of at least one embodiment, a bitstream is formatted to include encoded data for a video signal having a first color component, a second color component, and a third color component in a first color space, wherein the first color component is a luma component, and the second and third color components are chroma components, and wherein the first color component is weakly correlated with the second and third color components; a set of parameters used for transforming the second color component and the third color component into a transformed second color component and a transformed third color component in a second color space, wherein the transforming is based on PCA (Principal Component Analysis) and adaptive clipping bounds, wherein sample values of the first color component are clipped, at an encoder or decoder, in the first color space, the clipped sample values of the first color component being used for encoding or decoding the video signal, wherein sample values of the transformed second color component and the transformed third color component are clipped, responsive to the adaptive clipping bounds, and wherein the clipped sample values of the transformed second color component and the transformed third color component are inverse transformed.

The present embodiments also provide an apparatus for processing video data according to the methods described above.

<FIG> illustrates an exemplary HEVC encoder <NUM>. To encode a video sequence with one or more pictures, a picture is partitioned into one or more slices where each slice can include one or more slice segments. A slice segment is organized into coding units, prediction units and transform units.

In the present application, the terms "reconstructed" and "decoded" may be used interchangeably. Usually but not necessarily the term "reconstructed" is used at the encoder side while "decoded" is used at the decoder side.

The HEVC specification distinguishes between "blocks" and "units," where a "block" addresses a specific area in a sample array (e.g., luma, Y), and the "unit" includes the collocated block of all encoded color components (Y, Cb, Cr, or monochrome), syntax elements and prediction data that are associated with the block (e.g., motion vectors).

For coding, a picture is partitioned into coding tree blocks (CTB) of square shape with a configurable size, and a consecutive set of coding tree blocks is grouped into a slice. A Coding Tree Unit (CTU) contains the CTBs of the encoded color components. A CTB is the root of a quadtree partitioning into Coding Blocks (CB), and a Coding Block is partitioned into one or more Prediction Blocks (PB) and forms the root of a quadtree partitioning into Transform Blocks (TBs). Corresponding to the Coding Block, Prediction Block and Transform Block, a Coding Unit (CU) includes the Prediction Units (PUs) and the tree-structured set of Transform Units (TUs), a PU includes the prediction information for all color components, and a TU includes residual coding syntax structure for each color component. The size of a CB, PB and TB of the luma component applies to the corresponding CU, PU and TU. In the present application, the term "block" can be used to refer to any of CTU, CU, PU, TU, CB, PB and TB. In addition, the "block" can also be used to refer to a macroblock, a partition and a sub-block as specified in H. <NUM>/AVC or other video coding standards, and more generally to refer to an array of data of various sizes.

In the exemplary encoder <NUM>, a picture is encoded by the encoder elements as described below. The picture to be encoded is processed in units of CUs. Each CU is encoded using either an intra or inter mode. When a CU is encoded in an intra mode, it performs intra prediction (<NUM>). In an inter mode, motion estimation (<NUM>) and compensation (<NUM>) are performed. The encoder decides (<NUM>) which one of the intra mode or inter mode to use for encoding the CU, and indicates the intra/inter decision by a prediction mode flag. Prediction residuals are calculated by subtracting (<NUM>) the predicted block from the original image block.

CUs in intra mode are predicted from reconstructed neighboring samples within the same slice. A set of <NUM> intra prediction modes is available in HEVC, including a DC, a planar and <NUM> angular prediction modes. The intra prediction reference is reconstructed from the row and column adjacent to the current block. The reference extends over two times the block size in horizontal and vertical direction using available samples from previously reconstructed blocks. When an angular prediction mode is used for intra prediction, reference samples can be copied along the direction indicated by the angular prediction mode.

The applicable luma intra prediction mode for the current block can be coded using two different options. If the applicable mode is included in a constructed list of three most probable modes (MPM), the mode is signaled by an index in the MPM list. Otherwise, the mode is signaled by a fixed-length binarization of the mode index. The three most probable modes are derived from the intra prediction modes of the top and left neighboring blocks.

For an inter CU, the corresponding coding block is further partitioned into one or more prediction blocks. Inter prediction is performed on the PB level, and the corresponding PU contains the information about how inter prediction is performed.

The motion information (i.e., motion vector and reference picture index) can be signaled in two methods, namely, "merge mode" and "advanced motion vector prediction (AMVP).

In the merge mode, a video encoder or decoder assembles a candidate list based on already coded blocks, and the video encoder signals an index for one of the candidates in the candidate list. At the decoder side, the motion vector (MV) and the reference picture index are reconstructed based on the signaled candidate.

In AMVP, a video encoder or decoder assembles candidate lists based on motion vectors determined from already coded blocks. The video encoder then signals an index in the candidate list to identify a motion vector predictor (MVP) and signals a motion vector difference (MVD). At the decoder side, the motion vector (MV) is reconstructed as MVP+MVD.

In HEVC, the precision of the motion information for motion compensation is one quarter-sample (also referred to as quarter-pel or <NUM>/<NUM>-pel) for the luma component and one eighth-sample (also referred to as <NUM>/<NUM>-pel) for the chroma components. A <NUM>-tap or <NUM>-tap interpolation filter is used for interpolation of fractional-sample positions, i.e., <NUM>/<NUM>, <NUM>/<NUM> and <NUM>/<NUM> of full sample locations in both horizontal and vertical directions can be addressed for luma.

The prediction residuals are then transformed (<NUM>) and quantized (<NUM>). The quantized transform coefficients, as well as motion vectors and other syntax elements, are entropy coded (<NUM>) to output a bitstream. The encoder may also skip the transform and apply quantization directly to the non-transformed residual signal on a 4x4 TU basis. The encoder may also bypass both transform and quantization, i.e., the residual is coded directly without the application of the transform or quantization process. In direct PCM coding, no prediction is applied and the coding unit samples are directly coded into the bitstream.

The encoder decodes an encoded block to provide a reference for further predictions. The quantized transform coefficients are de-quantized (<NUM>) and inverse transformed (<NUM>) to decode prediction residuals. Combining (<NUM>) the decoded prediction residuals and the predicted block, an image block is reconstructed. In-loop filters (<NUM>) are applied to the reconstructed picture, for example, to perform deblocking/SAO filtering to reduce encoding artifacts. The filtered image is stored at a reference picture buffer (<NUM>).

<FIG> illustrates a block diagram of an exemplary HEVC video decoder <NUM>. In the exemplary decoder <NUM>, a bitstream is decoded by the decoder elements as described below. Video decoder <NUM> generally performs a decoding pass reciprocal to the encoding pass as described in <FIG>, which performs video decoding as part of encoding video data.

In particular, the input of the decoder includes a video bitstream, which may be generated by video encoder <NUM>. The bitstream is first entropy decoded (<NUM>) to obtain transform coefficients, motion vectors, and other coded information. The transform coefficients are de-quantized (<NUM>) and inverse transformed (<NUM>) to decode the prediction residuals. Combining (<NUM>) the decoded prediction residuals and the predicted block, an image block is reconstructed. The predicted block may be obtained (<NUM>) from intra prediction (<NUM>) or motion-compensated prediction (i.e., inter prediction) (<NUM>). As described above, AMVP and merge mode techniques may be used to derive motion vectors for motion compensation, which may use interpolation filters to calculate interpolated values for sub-integer samples of a reference block. In-loop filters (<NUM>) are applied to the reconstructed image. The filtered image is stored at a reference picture buffer (<NUM>).

To avoid data overflow or underflow, clipping is specified in various processes in an HEVC decoder. Different clipping functions are defined in HEVC, for example: <MAT> where Y and C denote the luma and chroma components, respectively, BitDepthY and BitDepthC are the internal bit depths (for example <NUM> or <NUM>) for the luma and chroma, respectively, and Clip3 is a function to clip a value z between two bounds x and y: <MAT>.

The clipping may be applied during or after various operations, for example, at or after weighted prediction, prediction, intra prediction filter, adaptive loop filter (ALF), deblocking filter, SAO filter and when the decoded residual is added to the prediction. Additionally, to further improve the performance of HEVC, clipping can also be applied at PDPC (Position dependent intra prediction combination) as developed in the reference software JEM (Joint Exploration Model) by the Joint Video Exploration Team (JVET).

The clipping process is typically done by: <MAT> where BL and BU are the lower and upper bounds of clipping respectively, and value x is clipped to value xc within the range of BL to BU. For example, default clipping bounds can be BL = <NUM> and BU = <NUM> for an <NUM>-bit IBD (Internal Bith Depth), and BL = <NUM> and BU = <NUM> for a <NUM>-bit IBD.

As shown in <FIG>, for ease of notation, we may refer to the input of the clipping operation as the "reconstructed value" or "reconstructed sample value," and the output of the clipping operation as the "clipped value" or "clipped sample value. " Because the clipping operation (<NUM>) may be performed at different stages of the encoding or decoding process (<NUM>, <NUM>), the reconstructed value may correspond to different data structures as described above, for example, but not limited to, the output of a deblocking filter, or the output of intra prediction. At the encoder, because of various encoding operations before the clipping, a reconstructed value may be different from the original value. By choosing a clipping bound adaptive to the video signal, the distortion between the clipped value and the original value may be smaller than the distortion between the reconstructed value and the original value, and therefore clipping may reduce the distortion in the encoding process.

The present principles are directed to adaptive clipping in video encoding and decoding. In various embodiments, we propose to determine the clipping bounds adaptive to the video signal. The various clipping embodiments may be used separately or in combination.

A histogram generally is a graphical representation of the probability distribution of sample values. <FIG> shows a histogram of an exemplary video signal with a data range of [m, M]. For this video signal, the histogram has high peaks at signal bounds m and M. Having peaks at signal bounds in a histogram is common for a video signal that goes through grading that purposely saturates the signal. For such a video signal, using the signal bounds as the clipping bounds may perform well in terms of reducing the signal distortion.

<FIG> shows a histogram of another exemplary video signal with a data range of [m, M]. In this example, there are no high peaks at the signal bounds in the histogram. For such a video signal, we may design a clipping bound that is different from the signal bound in order to reduce the distortion.

After a video signal goes through some encoding operations, a reconstructed sample value is typically distributed around the original sample value (either smaller, equal or greater), with a spread depending on the QP (Quantization Parameter). <FIG> illustrates a simplified exemplary histogram with <NUM> bars, <NUM>, <NUM>, <NUM>, (i.e., the original video signal here has three possible values M<NUM>, M<NUM> and M). After the video signal is encoded and reconstructed, the sample values may become smaller (from <NUM> to <NUM> or <NUM>, or from <NUM> to <NUM>), become larger (from <NUM> to <NUM> or <NUM>, from <NUM> to <NUM> or <NUM>, or from <NUM> to <NUM>), or maintain the same (from <NUM> to <NUM>, or from <NUM> to <NUM>), and the histogram becomes different as shown in <FIG>.

<FIG> illustrate the resulting histograms based on different upper clipping bounds. Using signal bound M as the upper clipping bound, only reconstructed sample values at bar <NUM> are clipped and bar <NUM> moves to bar <NUM> as shown in <FIG>. Thus, when the video signal has a small probability around the signal bounds, only a few samples benefit from the clipping, in this example, samples at bar <NUM> are corrected.

On the other hand, using M' < M as the upper clipping bound, sample values at bars <NUM>, <NUM>, <NUM>, <NUM> are all clipped to M' =M<NUM> (at bar <NUM>) as shown in <FIG>. Here, samples at bar <NUM>, with original value M, are clipped to M', and thus have a distortion of M - M'. Pixels at bars <NUM> and <NUM> are perfectly corrected after being clipped to M' = M<NUM>. For samples at bar <NUM>, with original values M<NUM>, the distortion is smaller when being clipped to M' than if not clipped when the clipping bound is M. Because there are fewer samples at bar <NUM> than at bars <NUM>, <NUM> and <NUM>, the overall distortion may be decreased when the clipping bound is set to M' instead of M. In general, by choosing a clipping bound different from the signal bound, the distortion may get reduced depending on the choice of M' and the probability distribution of the video signal.

<FIG> depicts an exemplary method <NUM> for determining adaptive clipping bounds at an encoder, according to an embodiment of the present principles. At first, a histogram hist(Y) of the video signal is built (<NUM>), wherein a bin of the histogram may correspond to one or more sample values. In this example, the histogram is built at a slice level based on the original values. The signal bound m and M are also obtained for the video signal. At steps <NUM>-<NUM>, the upper signal bound M and the histogram hist(Y) are used as input to decide the adaptive upper clipping bound M'. At steps <NUM>-<NUM>, the lower signal bound m and the histogram hist(Y) are used as input to decide the adaptive lower clipping bound m'. Because the clipping bounds may be different from the signal bounds, we also refer to this clipping method as "lossy clipping.

To derive the upper clipping bound, the reconstructed sample value corresponding to original sample value Y is estimated to be Y + Δy. Thus, for original sample value Y, the clipped sample value based on a candidate upper clipping bound x is min(Y + Δy, x), and the difference between the clipped value and the original value is min(Y + Δy, x) - Y. To derive upper clipping bound M', we test the distortions using different candidate clipping values around signal bound M. The test starts with signal bound M and moves towards smaller values. The distortion may first decrease (or maintain the same) and then increase, and the turning point is chosen as clipping bound M'.

In one embodiment, variable k is initialized to <NUM> (k = <NUM>) (<NUM>). Then distortions at candidate clipping bounds M - k and M - k - <NUM> are compared (<NUM>), wherein the distortion at clipping bound x can be calculated as: <MAT> If the distortion at M - k is larger or the same (<NUM>) than the distortion at M - k - <NUM>, k is incremented (<NUM>) by <NUM> (k = k + <NUM>), namely, the upper clipping bound M' moves further away from the upper signal bound M, and the loop returns to <NUM>. Otherwise, if the distortion at M - k is smaller (<NUM>), the upper clipping bound M' is set to be M - k (<NUM>). In other embodiments, k may be incremented by the number of sample values represented in a bin of the histogram, or k may be specified by the encoder.

To derive the lower clipping bound, the reconstructed value corresponding to original value Y is estimated to be Y - Δy. Thus, for original value Y, the clipped value based on a candidate lower clipping bound x is max(Y - Δy, x), and the difference between the clipped value and the original value is max(Y - Δy, x) - Y. To derive lower clipping bound m', we test the distortions using different candidate clipping values around signal bound m. The test starts with signal bound m and moves toward larger values. The distortion first decreases (or maintains the same) and then increases, and the turning point is chosen as clipping bound m'.

In one embodiment, to derive the lower clipping bound, variable k is initialized to <NUM> (k = <NUM>) (<NUM>). Then distortions at candidate clipping bounds m + k and m + k + <NUM> are compared (<NUM>), wherein the distortion at clipping bound x can be calculated as: <MAT> If the distortion at m + k is larger or the same (<NUM>) than the distortion at m + k + <NUM>, k is incremented (<NUM>) by <NUM> (k = k + <NUM>), namely, the lower clipping bound m' moves further away from the lower signal bound m, and the loop returns to <NUM>. Otherwise, if the distortion at m + k is smaller (<NUM>), the lower clipping bound m' is set to be m + k (<NUM>).

In the above, the difference between the clipped value and the original value is used as a distortion measure to determine the clipping bounds. More generally, we can use a score to decide the bounds. For example, we may use a RD (rate-distortion) score as a distortion measure, wherein the bit rate for encoding the bound and/or the clipped value is also considered.

The value of Δy used in Eqs. (<NUM>) and (<NUM>) may be set based on the quantization parameter, for example, as Δy = α × Qstep(QP)<NUM>, wherein α is a constant factor and Qstep is the quantization step size for QP. Alternatively, the value of Δy may be set based on a look-up table which provides a correspondence between QP and Δy. If there are several QPs that are used in encoding the video signal, Δy may be computed using, for example, but not limited to, the smallest QP, the highest one, or an average QP.

Method <NUM> can be adapted to be applied to the chrominance component of the video signal.

In the above, the clipping bounds are derived at the slice level based on the original signal. It should be noted that the clipping bounds can also be derived at block levels, for example, at the CTU level, and the clipping bounds can be derived using the reconstructed values if the reconstructed values are already available. If the reconstructed value Y' is known, the exact distortion of Y can be calculated. For example, Eq. (<NUM>) may become: <MAT> and Eq. (<NUM>) may become <MAT>.

After the clipping bounds m' and M' are derived, a sample may be clipped with BL = m' and BU = M'. For a decoder to correctly decoded the sample, the clipping bounds may be transmitted in the bitstream to the decoder.

<FIG> shows that sample values of an exemplary picture shown in <FIG> spread out in the YUV space, wherein U is the horizontal axis, and V is the vertical axis. It can be observed that along the U or V axis the sample values are not uniformly distributed and one component depends on other components. In the YUV space, clipping can be seen as limiting the sample values into a box defined by [BL,Y, BU,Y], [BL,U, BU,U], and [BL,V, BU,V], where BL,Y, BL,U and BL,V are the lower clipping bounds for the Y, U, and V components respectively, and BU,Y, BU,U and BU,V are the upper clipping bounds for the Y, U, and V components respectively. When the contour of the data spreading in the 3D YUV space is not similar to a box, the clipping may not be very effective in reducing distortion.

Assuming the signal bounds are used as the clipping bounds, the clipping box would enclose the data as shown in <FIG> very loosely. That is, there will be a large empty space between the data points and the clipping box. Thus, the clipping may only affect few samples and may not be very effective in reducing distortion. When lossy clipping as discussed above is used, the clipping box would be smaller than the clipping box based on the signal bounds. However, if there still is a large empty space between the data points and the tightened clipping box, the lossy clipping may still only affect a small amount of samples and may not be very effective in reducing the distortion.

<FIG> shows that a clipping box is defined on a transformed space in order to more tightly enclose the data points, wherein the points' colors represent the sample's density (lighter colors represent fewer samples, and darker colors represent more samples). By reducing the empty space between the data points and the clipping box, clipping may reduce distortion more effectively.

In one embodiment, we propose to determine a new color space using the Principal Component Analysis (PCA) of the input data. The parameters for the color space transform may be encoded and transmitted in the bitstream. In general, the transformation applied to an input data point X = [Y U V]t can be written as: <MAT> where <MAT> is a linear transformation matrix and <MAT> is a translation vector. The parameters for the color space transform, for example, coefficients rij, i, j = <NUM>,<NUM>,<NUM>, and Y<NUM>, U<NUM> and V<NUM> can be transmitted at different levels, for example, at a slice level or CTU level. The transformation X and R<NUM> can be found using, for example, a PCA decomposition of the YUV samples of the original image. ICA (Independent component analysis) can also be used instead of PCA. When using ICA, the transformed space might include more than three components if we choose to decompose on a basis larger than the initial space YUV.

After the color space transform, the clipping bounds can be determined based on the new color space at the encoder, for example, but not limited to, using the signal bounds or the bounds discussed above in lossy clipping. A sample in the transformed space then can be clipped using the boundaries BL and BU on individual components in the transformed space.

<FIG> shows an exemplary method <NUM> for performing clipping in a transformed color space, according to an embodiment of the present principles. The clipping in a transformed color space may be performed at both the encoder and decoder sides. Generally the same clipping method should be used at the encoder and decoder in order to synchronize the encoder and decoder. When the clipping is performed at the encoder side, the initialization step (<NUM>) includes determining the color space transform using the PCA and determining the clipping bounds. When the clipping is performed at the decoder side, the initialization step (<NUM>) includes decoding the color space transform parameters and the clipping bounds from the bitstream.

The video signal is then transformed from the YUV color space to a new space, for example, using Eq. (<NUM>). When the clipping is performed at the encoder side, the clipping bounds (BU,A, BL,A, BU,B, BL,B, BU,C, BL,C) may be determined based on the transformed video signal. The samples then can be clipped (<NUM>) as: <MAT> where BU,A, BL,A are the upper and lower clipping bounds for the A component respectively, BU,B, BL,B are the upper and lower clipping bounds for the B component respectively, BU,C, BL,C are the upper and lower clipping bounds for the C component respectively, <MAT> is a clipping function based on BL and BU: <MAT>, and Ac, Bc and Cc are the clipped values in the new color space.

At step <NUM>, the clipped samples are transformed from the transformed space back to the YUV space, for example, based on: <MAT> where Xc is the output clipped sample in the YUV space, T-<NUM> is the inverse matrix of T, Dc = [Ac Bc Cc]t.

In <FIG>, method <NUM> use all three color components when performing the transform, which is not part of the invention. For some video signals, we notice that the Y component is often weakly correlated with the U and V color components. Thus, in the claimed invention, the color transform is applied to only two of the three color components in the YUV color space, in particular to the U and V components. In this case, clipping is applied to the U and V components independently of the Y component. This is useful when clipping is to be done on the luma and chroma independently in the codec.

<FIG> shows an exemplary scheme of performing clipping of the U and V components in a transformed color space, according to an embodiment of the claimed invention. For the Y component, the clipping (<NUM>) is still performed in the YUV color space: <MAT>, and Yc is the clipped value.

On the other hand, the U and V components are transformed (<NUM>) to a new space, and the transformed components (D = [A B]t = T([U V]t - R<NUM>)) are clipped (<NUM>) in the new space as: <MAT> Then, the clipped samples are transformed (<NUM>) from the new space back to the UV space: <MAT> where Dc = [Ac Bc]t.

More generally, when a color space other than YUV is used, we determine a color component that is weakly correlated with other components, for example, when a cross correlation is below a threshold. Only the other color components may be clipped in a transformed space, and the weakly correlated color component may be clipped without color space transformation.

In the above, we describe deriving lower and upper clipping bounds or applying the clipping operation based on the lower and upper clipping bounds. In different variations, we may derive the bound or perform the clipping operation just for the lower or upper clipping bound. Referring back to <FIG> or <FIG>, we may derive the lossy bound for the upper bound, and use the signal bound for the lower bound, or we may derive the lossy bound for the lower bound, and use the signal bound for the upper bound. To synchronize the encoder and decoder, the same clipping operation usually should be applied at the encoder and decoder.

Various embodiments are described with respect to the HEVC standard. However, the present principles are not limited to HEVC, and can be applied to other standards, recommendations, and extensions thereof. The clipping operation may be used at different modules, for example, but not limited to, intra prediction module (<NUM>, <NUM>), in-loop filters (<NUM>, <NUM>), and motion compensation module (<NUM>, <NUM>), in an encoder or decoder.

Various methods are described above, and each of the methods comprises one or more steps or actions for achieving the described method. Unless a specific order of steps or actions is required for proper operation of the method, the order and/or use of specific steps and/or actions may be modified or combined.

Various numeric values are used in the present application, for example, the number of samples used in a bin in the histogram. It should be noted that the specific values are for exemplary purposes and the present principles are not limited to these specific values. In addition, when the above discussions use YUV videos as examples, the present principles can also be applied to different video formats, in different bit depths or color space.

<FIG> illustrates a block diagram of an exemplary system in which various aspects of the exemplary embodiments of the present principles may be implemented. System <NUM> may be embodied as a device including the various components described below and is configured to perform the processes described above. Examples of such devices, include, but are not limited to, personal computers, laptop computers, smartphones, tablet computers, digital multimedia set top boxes, digital television receivers, personal video recording systems, connected home appliances, and servers. System <NUM> may be communicatively coupled to other similar systems, and to a display via a communication channel as shown in <FIG> and as known by those skilled in the art to implement the exemplary video system described above.

The system <NUM> may include at least one processor <NUM> configured to execute instructions loaded therein for implementing the various processes as discussed above. Processor <NUM> may include embedded memory, input output interface and various other circuitries as known in the art. The system <NUM> may also include at least one memory <NUM> (e.g., a volatile memory device, a non-volatile memory device). System <NUM> may additionally include a storage device <NUM>, which may include non-volatile memory, including, but not limited to, EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk drive, and/or optical disk drive. The storage device <NUM> may comprise an internal storage device, an attached storage device and/or a network accessible storage device, as non-limiting examples. System <NUM> may also include an encoder/decoder module <NUM> configured to process data to provide an encoded video or decoded video.

Encoder/decoder module <NUM> represents the module(s) that may be included in a device to perform the encoding and/or decoding functions. As is known, a device may include one or both of the encoding and decoding modules. Additionally, encoder/decoder module <NUM> may be implemented as a separate element of system <NUM> or may be incorporated within processors <NUM> as a combination of hardware and software as known to those skilled in the art.

Program code to be loaded onto processors <NUM> to perform the various processes described hereinabove may be stored in storage device <NUM> and subsequently loaded onto memory <NUM> for execution by processors <NUM>. In accordance with the exemplary embodiments of the present principles, one or more of the processor(s) <NUM>, memory <NUM>, storage device <NUM> and encoder/decoder module <NUM> may store one or more of the various items during the performance of the processes discussed herein above, including, but not limited to the base layer input video, the enhancement layer input video, equations, formula, matrices, variables, operations, and operational logic.

The system <NUM> may also include communication interface <NUM> that enables communication with other devices via communication channel <NUM>. The communication interface <NUM> may include, but is not limited to a transceiver configured to transmit and receive data from communication channel <NUM>. The communication interface may include, but is not limited to, a modem or network card and the communication channel may be implemented within a wired and/or wireless medium. The various components of system <NUM> may be connected or communicatively coupled together using various suitable connections, including, but not limited to internal buses, wires, and printed circuit boards.

The exemplary embodiments according to the present principles may be carried out by computer software implemented by the processor <NUM> or by hardware, or by a combination of hardware and software. As a non-limiting example, the exemplary embodiments according to the present principles may be implemented by one or more integrated circuits. The memory <NUM> may be of any type appropriate to the technical environment and may be implemented using any appropriate data storage technology, such as optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memory and removable memory, as non-limiting examples. The processor <NUM> may be of any type appropriate to the technical environment, and may encompass one or more of microprocessors, general purpose computers, special purpose computers and processors based on a multi-core architecture, as non-limiting examples.

The implementations described herein may be implemented in, for example, a method or a process, an apparatus, a software program, a data stream, or a signal. Even if only discussed in the context of a single form of implementation (for example, discussed only as a method), the implementation of features discussed may also be implemented in other forms (for example, an apparatus or program). An apparatus may be implemented in, for example, appropriate hardware, software, and firmware. The methods may be implemented in, for example, an apparatus such as, for example, a processor, which refers to processing devices in general, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communication devices, such as, for example, computers, cell phones, portable/personal digital assistants ("PDAs"), and other devices that facilitate communication of information between end-users.

Reference to "one embodiment" or "an embodiment" or "one implementation" or "an implementation" of the present principles, as well as other variations thereof, mean that a particular feature, structure, characteristic, and so forth described in connection with the embodiment is included in at least one embodiment of the present principles. Thus, the appearances of the phrase "in one embodiment" or "in an embodiment" or "in one implementation" or "in an implementation", as well any other variations, appearing in various places throughout the specification are not necessarily all referring to the same embodiment.

Additionally, this application or its claims may refer to "determining" various pieces of information. Determining the information may include one or more of, for example, estimating the information, calculating the information, predicting the information, or retrieving the information from memory.

Further, this application or its claims may refer to "accessing" various pieces of information. Accessing the information may include one or more of, for example, receiving the information, retrieving the information (for example, from memory), storing the information, processing the information, transmitting the information, moving the information, copying the information, erasing the information, calculating the information, determining the information, predicting the information, or estimating the information.

Additionally, this application or its claims may refer to "receiving" various pieces of information. Receiving is, as with "accessing", intended to be a broad term. Receiving the information may include one or more of, for example, accessing the information, or retrieving the information (for example, from memory). Further, "receiving" is typically involved, in one way or another, during operations such as, for example, storing the information, processing the information, transmitting the information, moving the information, copying the information, erasing the information, calculating the information, determining the information, predicting the information, or estimating the information.

Claim 1:
A method for processing video data, comprising:
accessing a video signal having a first color component, a second color component, and a third color component in a first color space, wherein the first color component is a luma component, and the second and third color components are chroma components, and wherein the first color component is weakly correlated with the second and third color components;
determining parameters for transforming and adaptive clipping bounds;
encoding the parameters for transforming;
transforming (<NUM>, <NUM>) the second color component and the third color component into a transformed second color component and a transformed third color component in a second color space, responsive to the parameters for transforming, wherein the transforming is based on PCA (Principal Component Analysis);
clipping (<NUM>), at an encoder, sample values of the transformed second color component and the transformed third color component, responsive to the adaptive clipping bounds;
inverse transforming (<NUM>, <NUM>) the clipped sample values of the transformed second color component and the transformed third color component; and
clipping (<NUM>), at the encoder, sample values of the first color component in the first color space.