In this task, you will be presented with a context from an academic paper and a question separated with a 
. You have to answer the question based on the context.

[Q]: In addition, we have another independent human evaluation task about the style strength – we present the generated headlines from TitleStylist and baselines to the human judges and let them choose the one that most conforms to the target style such as humor. Then we define the style strength score as the proportion of choices. 
 Question: How is presence of three target styles detected?
[A]: human evaluation task about the style strength


[Q]: For DQA four participants answered each question, therefore we took the average INLINEFORM0 , INLINEFORM1 , and INLINEFORM2 values over the four evaluators as the result per question. The detailed answers by the participants and available online. To assess the correctness of the answers given both by participants in the DQA experiments, and by the QALD system, we use the classic information retrieval metrics of precision (P), recall (R), and F1. INLINEFORM0 measures the fraction of relevant (correct) answer (items) given versus all answers (answer items) given. 
 Question: Do they test performance of their approaches using human judgements?
[A]: Yes


[Q]: Finally, the morphosyntactic annotation was performed automatically, which may lead to errors, especially in the case of noisy web text. 
 Question: Did they use a crowdsourcing platform for annotations?
[A]:
No