In this task, you will be presented with a context from an academic paper and a question based on the context. You have to classify the questions into "Extractive", "Abstractive", or "Yes-no" questions. Extractive questions can be answered by concatenating extracts taken from a context into a summary while answering abstractive questions involves paraphrasing the context using novel sentences. Yes-no question is a question whose expected answer is one of two choices, one that affirms the question and one that denies the question. Typically, the choices are either yes or no.

Q: The result on original WikiQA indicates that all three transfer learning methods not only do not improve the results but also hurt the F1-score. These are because other datasets could not add new information to the original dataset or they apparently add some redundant information which are dissimilar to the target dataset. 
 Question: Do transferring hurt the performance is the corpora are not related?

A: Yes-no
****
Q: Building Extractive CNN/Daily Mail 
 Question: What is the problem with existing metrics that they are trying to address?

A: Abstractive
****
Q: Benchmark Evaluation ::: Classifier Models
SVM: A linear support vector machine with bag-of-words sentence representations.

MLP: A multi-layer perceptron with USE embeddings BIBREF4 as input.

FastText: A shallow neural network that averages embeddings of n-grams BIBREF5.

CNN: A convolutional neural network with non-static word embeddings initialized with GloVe BIBREF6.

BERT: A neural network that is trained to predict elided words in text and then fine-tuned on our data BIBREF1.

Platforms: Several platforms exist for the development of task-oriented agents. We consider Google's DialogFlow and Rasa NLU with spacy-sklearn. 
 Question: Which classifiers are evaluated?

A:
Extractive
****