The reference is the same for both. Another problem is that people have a reference based on experience, whether they see a specific reference or not. It was noted that in previous tests there was considerable variation among experts on subjective quality, even in open discussions. This is why a very large panel is needed. David Fibush remarked that Joint Working Party 10-11Q has agreed to work on the issue of expert viewers versus home viewers for more critical measurements.
Subjective measurements can change from day to day.
There was a suggestion we come up with something that uses a reference sequence and compares a compressed image with that. David Fibush agreed that we need a standard set of scenes to check measurement system results. VQEG requires monotonicity. David Fibush reported that once the VQEG test data is available, there will be a meeting to evaluate it. Leon Stanger was not present at the meeting.