Instructions: In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.
Input: We use the additional INLINEFORM0 training articles labeled by publisher as an unsupervised data set to further train the BERT model. We first investigate the impact of pre-training on BERT-BASE's performance. On the same computer, fine tuning the model on the small training set took only about 35 minutes for sequence length 100.
Output:
How are the two different models trained?