In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

[Q]: We used a dataset provided by Shortir, an Indonesian news aggregator and summarizer company. The dataset contains roughly 20K news articles. Each article has the title, category, source (e.g., CNN Indonesia, Kumparan), URL to the original article, and an abstractive summary which was created manually by a total of 2 native speakers of Indonesian
Question: Did they use a crowdsourcing platform for the summaries?
[A]: No

[Q]: It is interesting to observe that the baseline model amplifies the bias in the training data set as measured by INLINEFORM0 and INLINEFORM1 . From measurements using the described bias metrics, our method effectively mitigates bias in language modelling without a significant increase in perplexity.
Question: how is mitigation of gender bias evaluated?
[A]: Using INLINEFORM0 and INLINEFORM1

[Q]: Yet, we noticed a common misbehavior for all our multimodal models: if the attention loose track of the objects in the picture and "gets lost", the model still takes it into account and somehow overrides the information brought by the text-based annotations. The translation is then totally mislead.
Question: What misbehavior is identified?
[A]:
if the attention loose track of the objects in the picture and "gets lost", the model still takes it into account and somehow overrides the information brought by the text-based annotations