Patent ID: 8150172
Filing Date: 2012-04-03
Classification: H04N

Abstract:
1. A method for processing digital video data, the method comprising: identifying, by a processor, one or more transform coefficients for residual data of a block of pixels that are non zero and will remain non zero when quantized, wherein the identifying is performed without quantizing the one or more transform coefficients; generating a matrix of the transform coefficients, wherein a number of rows of the matrix of transform coefficients is equal to a number of rows of pixels in the block and a number of columns of the matrix of transform coefficients is equal to a number of columns of pixels in the block; comparing the matrix of transform coefficients to a matrix of thresholds, wherein the matrix of thresholds has a dimension the same as that of the matrix of transform coefficients, and further wherein the comparison results in a matrix of ones and zeros, where the zeros represent locations in the matrix of transform coefficients that will become zero after quantization and the ones represent locations in the matrix of transform coefficients that will remain non zero after quantization; summing a number of ones in the matrix of ones and zeros to compute a number of the transform coefficients identified as remaining non zero when quantized; summing absolute values of at least one of the transform coefficients in the matrix of transform coefficients that correspond to the location of the ones in the matrix of ones and zeros; estimating a number of bits associated with coding of the residual data based on at least the number of non zero transform coefficients and the sum of the at least one non zero transform coefficient; and estimating a coding cost for coding the block of pixels based on at least the estimated number of bits associated with coding the residual data.