Q: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
We showed in BIBREF22 that Pearson correlation is badly suited for STS. Instead, we compute the Spearman's rank correlation between the cosine-similarity of the sentence embeddings and the gold labels.
Question: What metrics are used for the STS tasks?
A:
Spearman's rank correlation between the cosine-similarity of the sentence embeddings and the gold labels