TASK DEFINITION: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
PROBLEM: We use datasets from the NIST DUC-05, DUC-06 and DUC-07 shared tasks BIBREF7, BIBREF19, BIBREF20. Given a question and a cluster of newswire documents, the contestants were asked to generate a 250-word summary answering the question. DUC-05 contains 1,600 summaries (50 questions x 32 systems); in DUC-06, 1,750 summaries are included (50 questions x 35 systems); and DUC-07 has 1,440 summaries (45 questions x 32 systems).
Question: What dataset do they use?

SOLUTION: datasets from the NIST DUC-05, DUC-06 and DUC-07 shared tasks

PROBLEM: The annotator carried out all annotation.
Question: How many annotators tagged each tweet?

SOLUTION: One

PROBLEM: The unlabeled set of development data was used in the training of both the UBM and the i-vector extractor.
Question: Do they single out a validation set from the fixed SRE training set?

SOLUTION:
No