Task: Question Answering
Input (English): Three annotators, who have no knowledge about which system the response is from, are then required to evaluate among win (response$_1$ is better), loss (response$_2$ is better) and tie (they are equally good or bad) independently, considering four aspects: coherence, logical consistency, fluency and diversity. 
 Question: What human judgement metrics are used?
Output (English): coherence, logical consistency, fluency and diversity