In this task, you will be presented with a context from an academic paper and a question separated with a 
. You have to answer the question based on the context.

Example Input: As shown in Table , the proposed PS-rnn-elmo shows a significant MAP performance improvement compared to the previous best model, CompClip-LM (0.696 to 0.734 absolute). 
 Question: How much better performance of proposed model compared to answer-selection models?
Example Output: significant MAP performance improvement compared to the previous best model, CompClip-LM (0.696 to 0.734 absolute)

Example Input: As previous systems collect relevant data from knowledge bases after observing questions during evaluation BIBREF24 , BIBREF25 , we also explore using this option. Namely, we build a customized text corpus based on questions in commonsense reasoning tasks.  
 Question: Do they fine-tune their model on the end task?
Example Output: Yes

Example Input: We conducted the human evaluation using Amazon Mechanical Turk to assess subjective quality. We recruit master level workers (who have good prior approval rates) to perform a human comparison between generated responses from two systems (which are randomly sampled from comparison systems). The workers are required to judge each utterance from 1 (bad) to 3 (good) in terms of informativeness and naturalness. Informativeness indicates the extent to which generated utterance contains all the information specified in the dialog act. Naturalness denotes whether the utterance is as natural as a human does. To reduce judgement bias, we distribute each question to three different workers. Finally, we collected in total of 5800 judges. 
 Question: What was the criteria for human evaluation?
Example Output:
to judge each utterance from 1 (bad) to 3 (good) in terms of informativeness and naturalness