Patent application EP19183146A (EP), filed 2019-06-28
Publication number: EP3757871A1
Title: DEVICE AND CORRESPONDING METHOD FOR CALCULATING VIDEO QUALITY INFORMATION OF A VIDEO SEQUENCE
Abstract: A device (10) for calculating video quality information of a video sequence is provided. The device (10) comprises a data acquisition unit (11) for acquiring at least one video frame with respect to the video sequence, and a calculation unit (12) connected to the data acquisition unit (11). In this context, the calculation unit (12) is configured to calculate at least one video quality indicator value on the basis of a non-linear transformation with the aid of at least one absolute gradient value with respect to the at least one video frame and at least one lateral average value with respect to the at least one video frame.
IPC codes: G06K   9/    00            A I
G06K   9/    03            A I
G06V  10/    98            A I
G06V  20/    40            A I
Claims: number: 1
text: A device (10) for calculating video quality information of a video sequence, the device comprising:
number: 2
text: The device (10) according to claim 1,
wherein the calculation unit (12) is configured to calculate the at least one video quality indicator value R on the basis of the following formula:  R = max 0 , E − S / E + S + c E ,
number: 3
text: The device (10) according to claim 2,
wherein the calculation unit (12) is configured to calculate the function c(E) on the basis of the following formula:  c E = 0. * c 0 + mean E ,
number: 4
text: The device (10) according to any of the claims 1 to 3, wherein the calculation unit (12) is configured to calculate at least one gradient value with respect to the at least one video frame on the basis of a derivative in horizontal direction with respect to an attribute A of the at least one video frame.
number: 5
text: The device (10) according to any of the claims 1 to 4, wherein the calculation unit (12) is configured to calculate at least one gradient value with respect to the at least one video frame on the basis of a derivative in vertical direction with respect to an attribute A of the at least one video frame.
number: 6
text: The device (10) according to any of the claims 1 to 5, wherein the calculation unit (12) is configured to calculate at least one difference of horizontally adjacent pixels of the at least one video frame with respect to an attribute A of the at least one video frame on the basis of the following formula:  H i j = phi A i j − A i j − 1 ,
number: 7
text: The device (10) according to any of the claims 1 to 6, wherein the calculation unit (12) is configured to calculate at least one difference of vertically adjacent pixels of the at least one video frame with respect to an attribute A of the at least one video frame on the basis of the following formula:  V i j = phi A i j − A i − 1 j ,
number: 8
text: The device (10) according to claim 6 or 7,
wherein the calculation unit (12) is configured to apply the non-linear strictly monotonic function phi() at each position of the at least one video frame especially in order to rescale the respective values to a fixed range, preferably to the range from -1 to 1.
number: 9
text: The device (10) according to claims 4 and 5,
wherein the calculation unit (12) is configured to calculate the at least one absolute gradient value E on the basis of a function depending on the derivative in horizontal direction and the derivative in vertical direction.
number: 10
text: The device (10) according to claims 6 and 7,
wherein the calculation unit (12) is configured to calculate the at least one absolute gradient value E on the basis of the following formula:  E = sqrt H * H + V * V ,
number: 11
text: The device (10) according to any of the claims 1 to 10, wherein with the aid of a small displacement vector of fixed length (di,dj) in direction of the gradient at position (i,j) of the at least one video frame, the calculation unit (12) is configured to calculate the lateral average value S(i,j) at position (i,j) on the basis of the following formula:  S i j = 0.5 * E i + di , j + dj + E i − di , j − dj ,
number: 12
text: The device (10) according to any of the claims 1 to 11, wherein the calculation unit (12) is configured to calculate the at least one video quality indicator value R in each of the at least one video frame for each position.
number: 13
text: The device (10) according to any of the claims 1 to 12, wherein the device (10) further comprises an output unit (13),
wherein the output unit (13) is configured to output the at least one video quality indicator value R to a file especially for further processing, and/or
wherein the output unit (13) is configured to display the at least one video quality indicator value R on a screen especially for further processing.
number: 14
text: The device (10) according to any of the claims 1 to 13, wherein the calculation unit (12) is configured to aggregate the at least one video quality indicator value R and to compare the aggregated at least one video quality indicator value R to at least one aggregated reference video quality indicator value Rref.
number: 15
text: A method for calculating video quality information of a video sequence, the method comprising the steps of:
Office action: search_report, dated 2020-12-30
Rejection reasons: novelty_epc_54
Prior art cited: ref_id: WO2016146038A1
ref_type: patent
severity: background
ref_id: - ANMIN LIU ET AL: "Image Quality Assessment Based on Gradient Similarity", IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 21, no. 4, 30 April 2012 (2012-04-30), pages 1500 - 1512, XP011491984, ISSN: 1057-7149, DOI: 10.1109/TIP.2011.2175935
ref_type: npl
severity: background
ref_id: - S. RAJKUMAR ET AL: "A Comparative Analysis on Image Quality Assessment for Real Time Satellite Images", INDIAN JOURNAL OF SCIENCE & TECHNOLOGY, vol. 9, no. 34, 23 September 2016 (2016-09-23), XP055651770, ISSN: 0974-6846, DOI: 10.17485/ijst/2016/v9i34/96766
ref_type: npl
severity: background
ref_id: - ANMIN LIU ET AL, "Image Quality Assessment Based on Gradient Similarity", IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, (20120430), vol. 21, no. 4, doi:10.1109/TIP.2011.2175935, ISSN 1057-7149, pages 1500 - 1512, XP011491984 [X] 1-15 * the whole document *
ref_type: npl
severity: novelty_destroying
ref_id: - S. RAJKUMAR ET AL, "A Comparative Analysis on Image Quality Assessment for Real Time Satellite Images", INDIAN JOURNAL OF SCIENCE & TECHNOLOGY, (20160923), vol. 9, no. 34, doi:10.17485/ijst/2016/v9i34/96766, ISSN 0974-6846, XP055651770 [A] 1-15 * the whole document *
ref_type: npl
severity: background
Final disposition: pending (2020-12-30)