Q: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Table TABREF23 shows the Pearson, Spearman and Kendall correlation of Rouge and Sera, with pyramid scores. Interestingly, we observe that many variants of Rouge scores do not have high correlations with human pyramid scores. The lowest F-score correlations are for Rouge-1 and Rouge-L (with INLINEFORM0 =0.454). Weak correlation of Rouge-1 shows that matching unigrams between the candidate summary and gold summaries is not accurate in quantifying the quality of the summary.
Question: What different correlations result when using different variants of ROUGE scores?
A:
we observe that many variants of Rouge scores do not have high correlations with human pyramid scores