Teacher:In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Teacher: Now, understand the problem? Solve this instance: The output of a system with the target words in the predicted order is compared to the gold ranking of the DURel data set. As the metric to assess how well the model's output fits the gold ranking Spearman's $
ho $ was used. The higher Spearman's rank-order correlation the better the system's performance.
Question: How is evaluation performed?
Student:
As the metric to assess how well the model's output fits the gold ranking Spearman's $
ho $ was used