In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.
--------
Question: The whole dataset consists of 81,826 samples annotated by native English speakers. 80% of them are used as training set. 10% of them are used as validation set while the rest is used as test set. 3000 hard samples are selected from the test set.

Answer: What is the difference between the full test set and the hard test set?


Question: We first evaluate our converted embedding models on multi-language lexical similarity and relatedness tasks, as a sanity check, to make sure the word sense induction process did not hurt the general performance of the embeddings. Then, we test the sense embeddings on WSD task.

Answer: Was any extrinsic evaluation carried out?


Question: The incomplete dataset used for training is composed of lower-cased incomplete data obtained by manipulating the original corpora.

Answer:
Do they test their approach on a dataset without incomplete data?