Question: What was the weakness in Hassan et al's evaluation design?
Answer: MT developers to which crowd workers were compared are usually not professional translators, evaluation of sentences in isolation prevents raters from detecting translation errors, used not originally written Chinese test set