RiteeshGrandhi/sciclaimeval-shared-task huggingface dataset:
F1 of binary fact verification on the evaluation set for all datasets in a zero-shot generalization setup. Rows correspond to the training dataset and columns to the evaluated dataset.
Macro-F1 of 3-class fact verification for all datasets with sentence-level evidence in a zero-shot generalization setup. The size of training data is controlled to 800 samples for all datasets.
Class-wise F1 of 3-class fact verification for the zero-shot generalization setup (left) and the in-domain training setup (right). S: supports; R: refutes; N: NEI.
Macro-F1 of three-class fact verification for all datasets in a few-shot generalization setup .
Zero-shot generalization performance (macro-F1) when initialized with different pretraining models .
Macro-F1 of three-class fact verification with data augmentation (BART-gen) and other baselines. The (top, bottom) shows results for (zero-, few-)shot generalization, respectively.
A list of candidate fact verification datasets.
Macro-F1 of 3-class fact verification on the evaluation set for all datasets in a zero-shot generalization setup. The size of training data is controlled to 800 samples for all datasets. Rows correspond to the training dataset and columns to the evaluated dataset. The row SELF corresponds to the in-domain performance (training and testing on the same target dataset).
Few-shot generalization performance (macro-F1) when initialized with different pretraining models .