A.6 Additional results: secondary experiments
Here, we provide additional results from our second set of experiments that, due to space limitations, could not be included in the main text. We note that a version of LaGoNN outperforms or has the same performance of all methods, including our upper bound RoBERTa full , on 60% of all displayed results, and is the best performer relative to Sentence Transformer-based methods on 65%. This excludes LaGoNN cheap . This method showed strong performance on the Insincere Questions dataset, but hurts performance in other cases.
In cases when SetFit-based methods do outperform our system, the performances are comparable, usually within one point, yet they can be quite different when LaGoNN -based methods are the strongest. Below, we report the mean average precision \times 100 for all methods over five seeds with the standard deviation, except in the case of Hate Speech Offensive, where the evaluation measure is the macro-F1. Each table shows the results for a given dataset and a given label-balance distribution on the first, fifth, and tenth step followed by the average for all ten steps. In the table caption we provide a summary/interpretation of the results for a given setting.
LIAR appears to be the most difficult dataset for all methods. This is expected because it likely does not include enough context to determine the truth of a statement.

Method Insincere Questions Extreme 1^{st} 5^{th} 10^{th} Average RoBERTa full 19.9_{8.4} 30.9_{7.9} 42.0_{7.4} 33.5_{6.7} SetFit exp 24.1_{6.3} 29.2_{6.7} 36.7_{7.3} 31.7_{3.4} LaGoNN exp \textbf{30.7}_{8.9} 37.6_{6.1} 39.0_{6.1} 36.1_{2.3} SetFit lite 24.1_{6.3} 38.1_{6.3} 41.1_{6.5} 35.6_{5.5} LaGoNN lite \textbf{30.7}_{8.9} \textbf{41.8}_{8.3} \textbf{43.4}_{8.5} \textbf{39.3}_{4.4} RoBERTa freeze 19.9_{8.4} 34.1_{5.4} 37.9_{5.2} 32.5_{5.4} k NN 6.8_{0.4} 15.9_{3.4} 16.9_{4.3} 14.4_{3.0} SetFit 24.1_{6.3} 31.7_{4.9} 36.1_{5.4} 31.8_{3.6} LaGoNN \textbf{30.7}_{8.9} 39.3_{4.9} 41.2_{4.7} 38.4_{3.0} Probe 24.3_{8.4} 39.8_{5.6} 44.8_{4.2} 38.3_{6.2} LaGoNN cheap 23.6_{7.8} 40.7_{5.9} 45.3_{4.4} 38.6_{6.6}

Method Insincere Questions Imbalanced 1^{st} 5^{th} 10^{th} Average RoBERTa full 39.8_{5.5} 53.1_{4.6} 55.7_{1.2} 50.6_{4.4} SetFit exp 43.7_{2.7} 52.2_{1.9} 53.8_{0.9} 51.4_{2.9} LaGoNN exp \textbf{44.5}_{4.5} 52.7_{2.4} 55.4_{2.0} 51.8_{3.0} SetFit lite 43.7_{2.7} 52.9_{2.6} 55.8_{1.8} 52.2_{3.4} LaGoNN lite \textbf{44.5}_{4.5} \textbf{53.5}_{2.7} \textbf{55.9}_{2.4} \textbf{52.6}_{3.5} RoBERTa freeze 39.8_{5.5} 44.1_{3.6} 46.3_{2.4} 44.0_{2.0} k NN 23.9_{2.2} 30.3_{3.0} 31.6_{2.4} 30.0_{2.1} SetFit 43.7_{2.7} 47.6_{1.6} 50.1_{2.1} 47.6_{1.8} LaGoNN \textbf{44.5}_{4.5} 48.1_{2.2} 50.3_{1.7} 48.1_{1.9} Probe 40.4_{4.2} 49.4_{2.3} 52.3_{1.7} 49.0_{3.3} LaGoNN cheap 40.8_{4.3} 51.1_{2.4} 54.5_{1.4} 50.4_{4.0}

Method Insincere Questions Moderate 1^{st} 5^{th} 10^{th} Average RoBERTa full 48.1_{2.3} 54.7_{1.9} 57.5_{1.5} 53.9_{2.9} SetFit exp 48.9_{1.7} 53.9_{0.7} 54.2_{1.5} 52.3_{1.6} LaGoNN exp \textbf{49.8}_{1.6} 52.2_{1.9} 53.2_{3.3} 52.0_{1.4} SetFit lite 48.9_{1.7} \textbf{56.5}_{1.4} \textbf{58.7}_{0.6} \textbf{55.0}_{3.5} LaGoNN lite \textbf{49.8}_{1.6} 56.1_{2.8} 58.3_{1.5} 54.6_{3.5} RoBERTa freeze 48.1_{2.3} 50.2_{2.2} 52.0_{1.4} 50.2_{1.4} k NN 28.0_{2.4} 33.9_{2.8} 33.6_{2.0} 33.5_{1.9} SetFit 48.9_{1.7} 53.6_{1.9} 55.8_{1.7} 53.3_{2.2} LaGoNN \textbf{49.8}_{1.6} 54.4_{1.3} 56.9_{0.5} 54.2_{2.2} Probe 45.7_{2.1} 52.3_{1.8} 54.4_{1.1} 51.4_{2.5} LaGoNN cheap 45.7_{2.2} 54.4_{1.6} 56.4_{0.6} 53.2_{3.2}

Method Insincere Questions Balanced 1^{st} 5^{th} 10^{th} Average RoBERTa full 47.1_{4.2} 52.1_{3.6} 55.7_{2.6} 52.5_{2.9} SetFit exp 43.5_{4.2} 47.1_{4.6} 48.5_{3.9} 48.0_{1.7} LaGoNN exp 42.8_{5.3} 47.6_{2.9} 47.0_{1.7} 46.2_{2.0} SetFit lite 43.5_{4.2} \textbf{54.6}_{2.4} \textbf{59.6}_{0.9} 53.6_{5.8} LaGoNN lite 42.8_{5.3} 53.5_{3.7} 58.6_{2.5} 52.2_{6.4} RoBERTa freeze 47.1_{4.2} 52.1_{0.4} 53.3_{1.1} 51.5_{2.1} k NN 22.3_{2.3} 30.2_{2.3} 30.9_{1.8} 29.5_{2.5} SetFit 43.5_{4.2} 53.8_{2.2} 55.5_{1.6} 52.8_{3.5} LaGoNN 42.8_{5.3} 54.1_{2.9} 56.3_{1.3} 53.4_{3.7} Probe 47.5_{1.6} 52.4_{1.7} 55.3_{1.1} 52.2_{2.5} LaGoNN cheap \textbf{49.3}_{2.6} 54.4_{1.4} 57.6_{0.7} \textbf{54.2}_{2.7}

Method Amazon Counterfactual Extreme 1^{st} 5^{th} 10^{th} Average RoBERTa full 21.8_{6.6} 63.9_{10.2} 72.3_{3.0} 59.6_{16.8} SetFit exp 22.3_{8.8} 64.2_{3.3} 68.6_{4.6} 56.8_{14.9} LaGoNN exp \textbf{26.1}_{17.5} \textbf{68.4}_{4.4} \textbf{74.9}_{2.9} \textbf{63.2}_{16.7} SetFit lite 22.3_{8.8} 62.4_{5.1} 67.5_{5.2} 56.5_{14.7} LaGoNN lite \textbf{26.1}_{17.5} 68.3_{4.3} 68.9_{4.3} 60.6_{15.1} RoBERTa freeze 21.8_{6.6} 41.0_{12.7} 51.3_{10.7} 40.6_{8.9} k NN 10.3_{0.2} 15.3_{4.2} 18.4_{3.7} 15.6_{2.4} SetFit 22.3_{8.8} 32.4_{11.5} 42.3_{8.8} 34.5_{5.9} LaGoNN \textbf{26.1}_{17.5} 31.1_{19.4} 33.0_{19.1} 30.9_{2.3} Probe 24.2_{9.0} 46.3_{4.4} 54.6_{2.0} 45.1_{10.3} LaGoNN cheap 20.1_{6.9} 38.3_{4.9} 47.8_{3.4} 38.2_{9.5}

Method Amazon Counterfactual Imbalanced 1^{st} 5^{th} 10^{th} Average RoBERTa full 68.2_{4.5} \textbf{81.0}_{1.7} \textbf{82.2}_{1.0} 79.2_{3.9} SetFit exp 72.0_{2.1} 78.4_{2.8} 78.8_{1.2} 78.0_{2.1} LaGoNN exp \textbf{74.3}_{3.8} 80.1_{1.4} 79.0_{1.6} 79.5_{1.9} SetFit lite 72.0_{2.1} 79.1_{1.4} 81.6_{1.3} 79.1_{2.7} LaGoNN lite \textbf{74.3}_{3.8} 79.2_{1.7} 81.9_{1.1} \textbf{80.2}_{2.2} RoBERTa freeze 68.2_{4.5} 75.0_{2.2} 77.0_{2.4} 74.2_{2.6} k NN 51.0_{4.1} 60.0_{3.1} 61.3_{2.1} 59.7_{3.0} SetFit 72.0_{2.1} 74.4_{2.3} 76.7_{1.8} 74.8_{1.4} LaGoNN \textbf{74.3}_{3.8} 76.1_{3.6} 77.3_{3.2} 76.1_{1.0} Probe 46.6_{2.8} 60.3_{1.4} 64.2_{1.2} 59.2_{5.2} LaGoNN cheap 38.2_{3.2} 55.3_{1.8} 61.0_{1.2} 54.4_{6.7}

Method Amazon Counterfactual Moderate 1^{st} 5^{th} 10^{th} Average RoBERTa full 73.9_{2.5} 80.0_{1.0} 80.1_{2.3} 79.1_{2.1} SetFit exp 76.5_{1.6} 77.0_{2.4} 74.7_{0.5} 76.5_{1.0} LaGoNN exp \textbf{78.6}_{2.2} 78.0_{2.1} 76.3_{4.9} 78.2_{1.0} SetFit lite 76.5_{1.6} 80.4_{3.8} \textbf{83.5}_{0.8} 80.3_{2.8} LaGoNN lite \textbf{78.6}_{2.2} 80.8_{1.9} 83.1_{0.7} \textbf{81.0}_{1.7} RoBERTa freeze 73.9_{2.5} 76.6_{1.4} 78.5_{0.7} 76.4_{1.7} k NN 54.5_{3.1} 64.2_{1.9} 66.6_{1.3} 64.7_{3.5} SetFit 76.5_{1.6} 80.6_{0.5} 81.2_{0.3} 80.0_{1.4} LaGoNN \textbf{78.6}_{2.2} \textbf{81.2}_{1.4} 81.6_{1.1} 80.8_{0.9} Probe 52.3_{2.0} 64.1_{1.8} 67.2_{1.4} 63.1_{4.3} LaGoNN cheap 47.3_{3.4} 60.7_{1.5} 65.2_{1.4} 59.5_{5.2}

Method Amazon Counterfactual Balanced 1^{st} 5^{th} 10^{th} Average RoBERTa full 73.6_{2.1} 78.6_{3.9} 82.4_{1.1} 78.9_{2.2} SetFit exp 73.8_{4.4} 69.8_{4.0} 64.1_{4.6} 69.6_{3.6} LaGoNN exp \textbf{76.0}_{3.0} 73.4_{2.6} 72.3_{2.9} 72.5_{3.4} SetFit lite 73.8_{4.4} \textbf{80.4}_{1.8} 82.4_{0.8} 78.3_{4.3} LaGoNN lite \textbf{76.0}_{3.0} 80.0_{1.3} \textbf{82.5}_{0.9} 79.2_{3.2} RoBERTa freeze 73.6_{2.1} 76.8_{1.6} 77.9_{1.0} 76.5_{1.3} k NN 41.7_{3.4} 57.9_{3.3} 58.3_{3.3} 56.8_{5.1} SetFit 73.8_{4.4} 79.2_{1.9} 80.1_{1.0} 78.6_{1.8} LaGoNN \textbf{76.0}_{3.0} 80.1_{2.0} 81.4_{1.1} \textbf{79.8}_{1.4} Probe 52.4_{3.4} 64.7_{2.5} 67.5_{0.4} 63.4_{4.4} LaGoNN cheap 48.1_{3.4} 62.0_{2.0} 65.3_{0.8} 60.5_{5.0}

Method Toxic Conversations Extreme 1^{st} 5^{th} 10^{th} Average RoBERTa full 7.9_{0.5} 21.2_{3.7} 33.8_{5.5} 21.9_{9.3} SetFit exp 8.8_{1.2} 18.1_{3.4} 24.7_{4.1} 17.6_{5.5} LaGoNN exp 8.9_{1.7} 17.4_{6.6} 26.4_{5.2} 17.9_{6.0} SetFit lite 8.8_{1.2} 15.9_{4.8} 18.0_{3.9} 14.9_{3.2} LaGoNN lite 8.9_{1.7} 16.1_{5.9} 19.8_{6.0} 15.5_{3.7} RoBERTa freeze 7.9_{0.5} 12.8_{2.4} 19.1_{3.2} 13.5_{3.5} k NN 7.9_{0.0} 8.7_{0.4} 8.7_{0.2} 8.5_{0.3} SetFit 8.8_{1.2} 13.1_{2.5} 16.3_{3.0} 13.0_{2.6} LaGoNN 8.9_{1.7} 13.8_{3.9} 17.1_{4.8} 13.4_{2.6} Probe \textbf{13.1}_{2.8} \textbf{24.6}_{2.6} \textbf{30.1}_{2.1} \textbf{23.9}_{5.6} LaGoNN cheap 11.3_{2.2} 21.7_{2.7} 27.4_{2.3} 21.3_{5.3}

Method Toxic Conversations Imbalanced 1^{st} 5^{th} 10^{th} Average RoBERTa full \textbf{24.1}_{5.6} 43.1_{3.4} 52.1_{2.5} 42.4_{8.2} SetFit exp 21.8_{6.6} 44.5_{4.1} 51.4_{1.9} 42.1_{9.3} LaGoNN exp 22.7_{9.8} \textbf{49.1}_{5.6} \textbf{53.4}_{2.3} \textbf{45.6}_{9.8} SetFit lite 21.8_{6.6} 41.4_{4.4} 44.8_{3.1} 39.0_{7.0} LaGoNN lite 22.7_{9.8} 47.0_{6.3} 50.2_{5.4} 43.7_{8.6} RoBERTa freeze \textbf{24.1}_{5.6} 31.2_{4.4} 34.0_{4.0} 30.5_{3.1} k NN 11.5_{2.5} 14.7_{4.0} 15.3_{3.2} 14.6_{1.1} SetFit 21.8_{6.6} 26.7_{5.3} 30.2_{4.0} 26.6_{2.7} LaGoNN 22.7_{9.8} 27.6_{8.9} 30.3_{8.7} 27.4_{2.4} Probe 23.3_{2.7} 33.0_{2.8} 37.1_{1.8} 32.5_{4.2} LaGoNN cheap 20.5_{3.2} 31.1_{3.2} 35.6_{1.8} 30.5_{4.6}

Method Toxic Conversations Moderate 1^{st} 5^{th} 10^{th} Average RoBERTa full 34.2_{3.4} 45.5_{1.9} 52.4_{3.3} 45.7_{5.6} SetFit exp 33.6_{2.9} 47.2_{2.2} 46.6_{3.3} 44.3_{4.3} LaGoNN exp \textbf{36.6}_{4.2} 48.2_{2.7} 49.9_{3.7} 48.0_{4.4} SetFit lite 33.6_{2.9} 52.6_{2.0} 55.1_{1.6} 48.8_{7.3} LaGoNN lite \textbf{36.6}_{4.2} \textbf{56.1}_{1.5} \textbf{57.7}_{1.4} \textbf{52.3}_{6.8} RoBERTa freeze 34.2_{3.4} 38.4_{2.1} 39.5_{1.8} 38.0_{1.5} k NN 19.4_{1.9} 21.5_{3.4} 22.4_{2.9} 21.6_{0.8} SetFit 33.6_{2.9} 39.2_{2.9} 41.6_{2.7} 38.6_{2.4} LaGoNN \textbf{36.6}_{4.2} 42.7_{3.7} 45.0_{3.5} 42.0_{2.5} Probe 29.0_{2.7} 36.1_{1.2} 39.1_{1.5} 35.5_{3.3} LaGoNN cheap 26.1_{2.7} 34.3_{1.3} 37.5_{1.8} 33.6_{3.6}

Method Toxic Conversations Balanced 1^{st} 5^{th} 10^{th} Average RoBERTa full 32.3_{1.1} 42.7_{1.8} 54.1_{3.4} 43.8_{6.3} SetFit exp 35.7_{3.4} 32.6_{6.2} 37.4_{2.7} 36.5_{1.9} LaGoNN exp \textbf{40.4}_{4.4} 40.2_{6.6} 39.8_{7.5} 40.0_{1.2} SetFit lite 35.7_{3.4} 52.7_{2.5} 53.9_{2.2} 46.8_{7.8} LaGoNN lite \textbf{40.4}_{4.4} \textbf{52.9}_{2.6} \textbf{54.0}_{2.3} \textbf{48.3}_{6.4} RoBERTa freeze 32.3_{1.1} 39.2_{1.5} 41.0_{0.6} 38.5_{2.4} k NN 17.4_{0.8} 23.7_{2.6} 24.3_{2.7} 23.1_{2.0} SetFit 35.7_{3.4} 44.5_{2.9} 46.1_{2.8} 43.6_{2.9} LaGoNN \textbf{40.4}_{4.4} 46.6_{2.7} 48.1_{2.2} 46.1_{2.2} Probe 29.5_{2.4} 35.9_{0.9} 40.2_{0.9} 36.1_{3.5} LaGoNN cheap 26.8_{2.7} 34.5_{1.3} 38.5_{0.8} 34.4_{3.7}

Method Hate Speech Offensive Extreme 1^{st} 5^{th} 10^{th} Average RoBERTa full 30.2_{1.4} 43.5_{2.5} \textbf{51.2}_{2.2} \textbf{44.3}_{7.4} SetFit exp 30.3_{0.8} \textbf{44.0}_{1.3} 51.1_{2.0} 43.8_{6.5} LaGoNN exp 30.3_{0.7} 40.7_{2.9} 49.1_{4.4} 42.2_{6.2} SetFit lite 30.3_{0.8} 43.4_{2.5} 45.5_{3.4} 41.6_{4.6} LaGoNN lite 30.3_{0.7} 40.9_{3.4} 41.5_{4.8} 39.1_{3.6} RoBERTa freeze 30.2_{1.4} 33.5_{3.1} 34.4_{3.4} 33.1_{1.4} k NN \textbf{31.5}_{1.2} 35.9_{2.7} 37.4_{2.0} 35.8_{1.7} SetFit 30.3_{0.8} 38.4_{2.5} 41.1_{1.5} 37.8_{3.3} LaGoNN 30.3_{0.7} 35.7_{2.6} 39.1_{2.4} 35.6_{2.7} Probe 29.0_{0.2} 34.7_{1.5} 40.1_{2.1} 35.1_{3.8} LaGoNN cheap 29.0_{0.1} 36.9_{1.8} 40.5_{2.1} 36.2_{3.7}

Method Hate Speech Offensive Imbalanced 1^{st} 5^{th} 10^{th} Average RoBERTa full 50.6_{3.0} 65.2_{3.9} \textbf{70.3}_{1.2} 64.2_{5.3} SetFit exp 54.4_{4.3} 66.3_{1.8} 68.9_{2.0} 64.3_{4.5} LaGoNN exp \textbf{57.0}_{5.2} \textbf{67.0}_{4.4} 69.8_{2.1} \textbf{64.9}_{4.6} SetFit lite 54.4_{4.3} 65.5_{3.0} 65.9_{3.5} 63.5_{3.9} LaGoNN lite \textbf{57.0}_{5.2} 66.6_{2.6} 66.6_{1.9} 64.3_{4.1} RoBERTa freeze 50.6_{3.0} 54.1_{1.6} 55.3_{2.3} 54.1_{1.3} k NN 55.6_{4.8} 57.3_{2.3} 58.8_{3.6} 57.4_{1.1} SetFit 54.4_{4.3} 57.0_{3.9} 58.2_{3.8} 57.2_{1.1} LaGoNN \textbf{57.0}_{5.2} 58.2_{4.1} 58.3_{3.4} 58.3_{0.6} Probe 46.5_{2.2} 57.8_{1.7} 60.3_{1.2} 56.5_{4.5} LaGoNN cheap 47.1_{1.3} 56.5_{2.2} 59.5_{2.5} 55.6_{3.8}

Method Hate Speech Offensive Moderate 1^{st} 5^{th} 10^{th} Average RoBERTa full 61.9_{3.4} 70.8_{1.0} \textbf{72.5}_{1.4} 69.9_{3.2} SetFit exp \textbf{64.3}_{4.2} 70.6_{2.4} 72.4_{0.5} 69.8_{2.8} LaGoNN exp 63.8_{4.9} \textbf{71.0}_{2.1} 72.3_{1.0} \textbf{70.0}_{3.0} SetFit lite 64.3_{4.2} 70.3_{2.2} 71.2_{2.1} 69.3_{2.3} LaGoNN lite 63.8_{4.9} 70.7_{1.4} 71.4_{1.0} 69.4_{2.5} RoBERTa freeze 61.9_{3.4} 63.2_{4.1} 64.1_{4.5} 63.2_{0.6} k NN \textbf{64.3}_{4.0} 63.3_{2.9} 63.9_{2.5} 63.7_{0.4} SetFit \textbf{64.3}_{4.2} 67.3_{3.2} 67.6_{2.3} 66.9_{1.1} LaGoNN 63.8_{4.9} 65.0_{5.3} 66.7_{5.9} 65.3_{0.9} Probe 55.6_{1.7} 63.8_{0.8} 66.1_{0.3} 63.2_{3.0} LaGoNN cheap 56.0_{3.6} 62.2_{1.4} 66.0_{0.9} 62.3_{2.9}

Method Hate Speech Offensive Balanced 1^{st} 5^{th} 10^{th} Average RoBERTa full 59.7_{3.5} 66.9_{1.2} \textbf{69.2}_{1.8} \textbf{66.4}_{2.7} SetFit exp 60.7_{1.3} 66.3_{1.6} 67.5_{0.9} 65.9_{2.2} LaGoNN exp \textbf{61.5}_{1.7} 66.4_{1.4} 67.7_{0.9} 66.1_{1.8} SetFit lite 60.7_{1.3} 66.3_{2.0} 66.5_{0.9} 65.1_{1.7} LaGoNN lite \textbf{61.5}_{1.7} \textbf{67.1}_{1.1} 67.3_{0.8} 66.0_{1.7} RoBERTa freeze 59.7_{3.5} 60.4_{2.7} 63.1_{2.3} 61.0_{1.3} k NN 60.7_{1.3} 59.6_{2.8} 59.5_{2.5} 59.5_{0.5} SetFit 60.7_{1.3} 62.5_{0.7} 63.4_{1.0} 62.3_{1.0} LaGoNN \textbf{61.5}_{1.7} 62.8_{1.5} 64.2_{1.0} 63.0_{0.9} Probe 54.9_{1.4} 58.5_{0.9} 60.9_{0.4} 58.7_{1.7} LaGoNN cheap 54.2_{2.3} 58.6_{0.6} 60.6_{0.5} 58.5_{1.8}

Method LIAR Extreme 1^{st} 5^{th} 10^{th} Average RoBERTa full \textbf{32.0}_{2.7} \textbf{34.7}_{2.9} 35.1_{4.3} 33.7_{1.0} SetFit exp 31.2_{3.8} 30.4_{3.1} 31.8_{2.9} 31.5_{0.7} LaGoNN exp 30.6_{4.7} 30.3_{2.0} 31.3_{2.0} 31.1_{0.6} SetFit lite 31.2_{3.8} 32.7_{3.8} 33.5_{4.2} 32.7_{0.8} LaGoNN lite 30.6_{4.7} 31.8_{3.9} 32.4_{2.7} 31.6_{0.6} RoBERTa freeze \textbf{32.0}_{2.7} 32.8_{4.5} 34.2_{5.0} 33.2_{0.7} k NN 27.0_{0.5} 27.3_{0.8} 27.9_{0.8} 27.4_{0.3} SetFit 31.2_{3.8} 33.7_{5.1} \textbf{35.7}_{5.1} \textbf{34.3}_{1.6} LaGoNN 30.6_{4.7} 32.0_{4.6} 33.7_{5.4} 32.6_{0.9} Probe 30.7_{2.0} 30.6_{3.9} 31.7_{2.9} 31.1_{0.4} LaGoNN cheap 30.7_{2.0} 30.5_{3.8} 31.4_{2.6} 31.0_{0.4}

Method LIAR Imbalanced 1^{st} 5^{th} 10^{th} Average RoBERTa full 31.4_{3.2} 35.8_{2.6} \textbf{40.0}_{4.3} 36.2_{2.4} SetFit exp \textbf{32.3}_{4.5} 35.9_{3.1} 36.4_{2.2} 35.2_{1.1} LaGoNN exp \textbf{32.3}_{4.6} 35.7_{3.4} 36.5_{2.3} 35.7_{1.4} SetFit lite \textbf{32.3}_{4.5} 35.6_{2.7} 37.4_{2.6} 35.8_{1.6} LaGoNN lite \textbf{32.3}_{4.6} 35.2_{2.4} 36.6_{2.7} 35.5_{1.3} RoBERTa freeze 31.4_{3.2} 34.1_{2.6} 35.6_{3.2} 34.0_{1.4} k NN 27.0_{0.2} 28.5_{1.0} 29.0_{1.0} 28.7_{0.7} SetFit \textbf{32.3}_{4.5} \textbf{36.5}_{3.1} 38.5_{3.4} \textbf{36.3}_{2.0} LaGoNN \textbf{32.3}_{4.6} 34.9_{2.2} 36.9_{2.5} 35.3_{1.4} Probe 30.7_{3.0} 32.8_{1.8} 35.0_{1.6} 33.5_{1.5} LaGoNN cheap 30.4_{3.0} 32.9_{1.8} 35.4_{1.7} 33.5_{1.7}

Method LIAR Moderate 1^{st} 5^{th} 10^{th} Average RoBERTa full 33.9_{3.1} 38.4_{2.7} \textbf{43.9}_{2.2} \textbf{39.5}_{3.0} SetFit exp 33.0_{2.6} 37.2_{1.8} 38.7_{1.5} 37.4_{1.6} LaGoNN exp \textbf{34.1}_{3.4} \textbf{38.7}_{2.3} 39.0_{1.8} 37.8_{1.5} SetFit lite 33.0_{2.6} 38.5_{1.3} 40.4_{2.0} 38.2_{2.1} LaGoNN lite \textbf{34.1}_{3.4} 38.4_{2.0} 39.6_{1.5} 37.9_{1.6} RoBERTa freeze 33.9_{3.1} 35.3_{2.6} 36.8_{2.2} 35.4_{1.0} k NN 29.2_{0.8} 29.7_{1.5} 30.0_{0.6} 29.8_{0.3} SetFit 33.0_{2.6} 37.2_{3.9} 39.4_{3.5} 37.0_{1.8} LaGoNN \textbf{34.1}_{3.4} 37.0_{3.1} 38.6_{3.0} 36.8_{1.3} Probe 31.6_{1.1} 34.7_{2.5} 37.0_{2.5} 34.9_{1.7} LaGoNN cheap 31.4_{0.9} 35.3_{2.3} 37.6_{2.0} 35.3_{1.9}

Method LIAR Balanced 1^{st} 5^{th} 10^{th} Average RoBERTa full 33.8_{2.1} \textbf{39.4}_{2.4} \textbf{43.5}_{1.7} \textbf{40.2}_{3.2} SetFit exp \textbf{34.4}_{2.3} 36.7_{1.7} 37.0_{1.3} 36.5_{1.1} LaGoNN exp 33.8_{1.8} 34.2_{2.7} 37.2_{1.9} 36.2_{1.4} SetFit lite \textbf{34.4}_{2.3} 38.7_{2.3} 40.3_{2.8} 38.0_{2.1} LaGoNN lite 33.8_{1.8} 37.6_{2.0} 39.4_{2.8} 37.2_{1.9} RoBERTa freeze 33.8_{2.1} 36.6_{1.6} 38.6_{1.5} 36.7_{1.5} k NN 30.1_{0.4} 31.3_{2.1} 30.6_{1.1} 30.9_{0.4} SetFit \textbf{34.4}_{2.3} 38.3_{2.5} 40.0_{2.0} 37.9_{1.6} LaGoNN 33.8_{1.8} 38.3_{1.3} 40.6_{0.6} 38.1_{2.0} Probe 32.1_{1.9} 35.2_{1.4} 37.2_{2.5} 35.2_{1.7} LaGoNN cheap 31.9_{1.9} 36.0_{1.0} 37.5_{2.5} 35.7_{1.8}