Before revision:  I have had a close look at their data and their report, and I find that both the data itself and the method of presentation of the data to the human raters  are problematic.
After revision:  I have had a close look at their data and their report, and I find that both the data itself and the method of presentation of the data to the human raters , and the analysis of agreement statistics are problematic.