TASK DEFINITION: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
PROBLEM: We introduce a surrogate training objective that avoids these problems and as a result is fully continuous. Specifically, we form a continuous function softLB that seeks to approximate the result of running our decoder on input INLINEFORM0 and then evaluating the result against INLINEFORM1 using INLINEFORM2 .
Question: Do they provide a framework for building a sub-differentiable for any final loss metric?

SOLUTION: Yes

PROBLEM: In total around 500 different workers were involved in the annotation. about 500
Question: How many people participated in their evaluation study of table-to-text models?

SOLUTION: about 500

PROBLEM: Argus Dataset AI2-8grade/CK12 Dataset We consider this dataset as preliminary since it was not reviewed by a human and many hypotheses are apparently unprovable by the evidence we have gathered (i.e. the theoretical top accuracy is much lower than 1.0). MCTest Dataset We use an official extension of the dataset for RTE evaluation that again textually merges questions and answers.
Question: what datasets did they use?

SOLUTION:
Argus Dataset AI2-8grade/CK12 Dataset MCTest Dataset