Part 1. Definition
In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Part 2. Example
We evaluate the proposed approach on the Chinese social media text summarization task, based on the sequence-to-sequence model. Large-Scale Chinese Short Text Summarization Dataset (LCSTS) is constructed by BIBREF1 . The dataset consists of more than 2.4 million text-summary pairs in total, constructed from a famous Chinese social media microblogging service Weibo.
Question: Are results reported only for English data?
Answer: No
Explanation: Based on the context, the dataset is constructed from a famous Chinese social media microblogging service Weibo.
Part 3. Exercise
We adopt the following two datasets:

Quora BIBREF1: The Quora Question Pairs dataset contains question pairs annotated with labels indicating whether the two questions are paraphrases. We use the same dataset partition as BIBREF5, with 384,348/10,000/10,000 pairs in the training/development/test set respectively.

MRPC BIBREF34: The Microsoft Research Paraphrase Corpus consists of sentence pairs collected from online news. Each pair is annotated with a label indicating whether the two sentences are semantically equivalent. There are 4,076/1,725 pairs in the training/test set respectively.
Question: What are benhmark datasets for paraphrase identification?
Answer:
Quora MRPC