A method comprising: decoding, by at least two known functional video decoding devices, an encoded reference video frame; outputting, by each of the at least two known functional video decoding devices, at least two decoded reference video frames; calculating, for each of the at least two decoded reference video frames, a first reference value for a first block of the first decoded reference video frame using a plurality of pixel values associated with a plurality of pixels within the first block, the first reference value for the first block being calculated using a first part of each of the plurality of pixel values, the first part corresponding to a first color; calculating, for each of the at least two decoded reference video frames, a second reference value for the first block of the first decoded reference video frame, wherein the second reference value for the first block is calculated using a second part of each of the plurality of pixel values, the second part corresponding to a second color; calculating and storing an average first reference value using the first reference value calculated for each of the at least two decoded reference video frames; calculating and storing an average second reference value using the second reference value calculated for each of the at least two decoded reference video frames; receiving, by a video test computer system from a video decoding device under test, a first decoded video frame; calculating a first value for the first block of the first decoded video frame using a plurality of pixel values associated with a plurality of pixels within the first block, the first value for the first block being calculated using the first part of each of the plurality of pixel values, the first part corresponding to the first color; calculating a second value for the first block of the first decoded video frame, wherein the second value for the first block is calculated using the second part of each of the plurality of pixel values, the second part corresponding to the second color; retrieving a stored set of reference data corresponding to the first block, the stored set of reference data comprising the average first reference value corresponding to the first color and the average second reference value corresponding to the second color; and performing value comparisons by comparing the first value to the average first reference value and the average second value to the second reference value; and determining, by the video test computer system, whether the video decoding device is accurately decoding video based on whether at least a threshold number of value comparisons are matches within a threshold range. decoding, by at least two known functional video decoding devices, an encoded reference video frame; outputting, by each of the at least two known functional video decoding devices, at least two decoded reference video frames; calculating, for each of the at least two decoded reference video frames, a first reference value for a first block of the first decoded reference video frame using a plurality of pixel values associated with a plurality of pixels within the first block, the first reference value for the first block being calculated using a first part of each of the plurality of pixel values, the first part corresponding to a first color; calculating, for each of the at least two decoded reference video frames, a second reference value for the first block of the first decoded reference video frame, wherein the second reference value for the first block is calculated using a second part of each of the plurality of pixel values, the second part corresponding to a second color; calculating and storing an average first reference value using the first reference value calculated for each of the at least two decoded reference video frames; calculating and storing an average second reference value using the second reference value calculated for each of the at least two decoded reference video frames; receiving, by a video test computer system from a video decoding device under test, a first decoded video frame; calculating a first value for the first block of the first decoded video frame using a plurality of pixel values associated with a plurality of pixels within the first block, the first value for the first block being calculated using the first part of each of the plurality of pixel values, the first part corresponding to the first color; calculating a second value for the first block of the first decoded video frame, wherein the second value for the first block is calculated using the second part of each of the plurality of pixel values, the second part corresponding to the second color; retrieving a stored set of reference data corresponding to the first block, the stored set of reference data comprising the average first reference value corresponding to the first color and the average second reference value corresponding to the second color; and performing value comparisons by comparing the first value to the average first reference value and the average second value to the second reference value; and determining, by the video test computer system, whether the video decoding device is accurately decoding video based on whether at least a threshold number of value comparisons are matches within a threshold range.