RiteeshGrandhi/sciclaimeval-shared-task huggingface dataset:
Accuracy when using fewer systems with respect to final rankings (using all 16 systems) and the ground truth labels. Results shown for Summeval COH using FlanT5-xl.
Fraction of comparisons where the candidate in the first position was selected by the LLM when using the full (symmetric) set of comparisons. The bias is presented for both prompts, over all datasets and scores, extending the results in Table 5 .
Accuracy of pairwise comparisons of all candidates which differ in true value. Accuracies are shown for all datasets and scores, extending the results of Table 6 .
Spearman correlation when the comparisons are converted using either win-ratio or maximum likelihood, for FlanT5-3B on SummEval.