You will be given a definition of a task first, then some input of the task.
In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.

Probing into the assorted empirical results may help us discover some interesting phenomenons:

The advantage of pre-training gradually diminishes with the increase of labeled data BIBREF14, BIBREF17, BIBREF18.

Fixed representations yield better results than fine-tuning in some cases BIBREF24.

Overall, pre-training the Seq2Seq encoder outperforms pre-training the decoder BIBREF24, BIBREF17, BIBREF15, BIBREF16.
Output:
What experimental phenomena are presented?