In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.

Ex Input:
However, we also showed difference in produced errors for each method and different impact at word-level depending of the approach or units. Thus, future work will focus on analysing the orthographic output of these systems in two ways: 1) investigate errors produced by the end-to-end methods and explore several approaches to correct common errors done in French and 2) compare the end-to-end methods in a SLU context and evaluate the semantic value of the partially correct produced words.

Ex Output:
What will be in focus for future work?

Ex Input:
We have observed that the conflict model is very sensitive to even minor differences and compensates in such cases where attention poses high bias towards similarities already there in the sequences.

Sequence 1: What are the best ways to learn French ?

Sequence 2: How do I learn french genders ?

Attention only: 1

Attention+Conflict: 0

Ground Truth: 0

Sequence 1: How do I prevent breast cancer ?

Sequence 2: Is breast cancer preventable ?

Attention only: 1

Attention+Conflict: 0

Ground Truth: 0

We provide two examples with predictions from the models with only attention and combination of attention and conflict. Each example is accompanied by the ground truth in our data.

Ex Output:
Do they show on which examples how conflict works better than attention?

Ex Input:
To account for this, we compute the balanced accuracy, i.e., the average of the three accuracies on each class.

Ex Output:
Is model explanation output evaluated, what metric was used?