In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

Example Input: jiant System Overview ::: jiant Components
Tasks: Tasks have references to task data, methods for processing data, references to classifier heads, and methods for calculating performance metrics, and making predictions.
Question: Does jiant involve datasets for the 50 NLU tasks?
Example Output: Yes

Example Input: These workers completed 1001 tasks: 496 tasks in the control and 505 in the AUI.
Question: How many responses did they obtain?
Example Output: 1001

Example Input: For task 1, we use F1-score as evaluation metric. We use manual evaluation for task 2. There are five evaluation metrics for task 2 as following.

Task completion ratio: The number of completed tasks divided by the number of total tasks.

User satisfaction degree: There are five scores -2, -1, 0, 1, 2, which denote very dissatisfied, dissatisfied, neutral, satisfied and very satisfied, respectively.

Response fluency: There are three scores -1, 0, 1, which indicate nonfluency, neutral, fluency.

Number of dialogue turns: The number of utterances in a task-completed dialogue.

Guidance ability for out of scope input: There are two scores 0, 1, which represent able to guide or unable to guide.
Question: What metrics are used in the evaluation?
Example Output:
For task 1, we use F1-score Task completion ratio User satisfaction degree Response fluency Number of dialogue turns Guidance ability for out of scope input