In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.
--------
Question: We consider two different models for each language pair: the Baseline and the Document model. We evaluate them on 3 test sets and report BLEU and TER scores. All experiments are run 8 times with different seeds, we report averaged results and p-values for each experiment.

Answer: What evaluation metrics did they use?


Question: To find a large amount of hate speech on the refugee crisis, we used 10 hashtags that can be used in an insulting or offensive way.

Answer: How were potentially hateful messages identified?


Question: Lastly, the attention model, MDREA, also outperforms the best existing research results (WAP 0.690 to 0.688) BIBREF19 .

Answer:
By how much does their model outperform the state of the art results?