Given the task definition and input, reply with output. In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

For DQA four participants answered each question, therefore we took the average INLINEFORM0 , INLINEFORM1 , and INLINEFORM2 values over the four evaluators as the result per question. The detailed answers by the participants and available online. To assess the correctness of the answers given both by participants in the DQA experiments, and by the QALD system, we use the classic information retrieval metrics of precision (P), recall (R), and F1. INLINEFORM0 measures the fraction of relevant (correct) answer (items) given versus all answers (answer items) given.
Question: Do they test performance of their approaches using human judgements?
Yes