In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.

Ex Input:
The current release of Katecheo uses a Bi-Directional Attention Flow, or BiDAF, model for reading comprehension BIBREF6 . Future releases of Katecheo will include the ability to swap out the reading comprehension model for newer architectures based on, e.g., BERT BIBREF8 or XLNet BIBREF9 or custom trained models.

Architecture and Configuration

Ex Output:
what pretrained models were used?


Ex Input:
Compared with the BERT-BASE model, BERT-SPC significantly improves the accuracy and F1 score of aspect polarity classification.

Ex Output:
How much better is performance of the proposed model compared to the state of the art in these various experiments?


Ex Input:
As a warm-up procedure, the first 100 posts were annotated by two annotators (the author and the supervisor) and the results compared. The remainder of the annotation task was performed by the author, resulting in 3600 annotated samples.

Ex Output:

Who were the annotators?