Single Sentence Tasks
SST-2(acc)	SST-5(acc)	MR(acc)	CR(acc)	MPQA(acc)	Subj(acc)	TREC(acc)	CoLA(Matt.)
Majority (full)	50.9	23.1	50.0	50.0	50.0	50.0	18.8	0.0
Prompt-based zero-shot†	83.6	35.0	80.8	79.5	67.6	51.4	32.0	2.0
in-context learning	84.81,3	30.60,9	80.51,7	87.40,8	63.82,1	53.61,0	26.22,4	-1.52,4
Fully Supervised Learning
CLS-based FT	95.1	59.4	90.8	90.8	89.1	96.9	96.8	54.3
+ TAPT	96.0↑0,9	60.6↑1,2	91.4↑0,6	91.0↑0,2	89.9↑0,8	96.9↑0,0	97.6↑0,8	43.6↓10,7
Prompt-based FT (hard)	95.2	60.0	90.8	92.4	89.4	95.9	97.8	54.7
+ TAPT	93.5↓1,7	60.4↑0,4	90.3↓0,5	90.8↓1,6	89.5↑0,1	95.9↑0,0	97.6↓0,2	44.0↓10,7
+ PCP (ours)	95.5↑0,3	60.5↑0,5	91.7↑0,9	92.8↑0,4	89.6↑0,2	96.8↑0,9	97.8↑0,0	56.0↑1,3
Prompt-based FT (soft)	94.2	59.8	90.4	92.7	87.8	96.4	97.4	61.3
+ TAPT	92.7↓1,5	59.5↓0,3	91.8↑1,4	92.5↓0,2	89.5↑1,7	96.8↑0,4	97.8↑0,4	52.6↓8,7
+ PCP (ours)	94.3↑0,1	60.7↑0,9	91.8↑1,4	92.8↑0,1	90.4↑2,6	97.1↑0,7	98.0↑0,6	62.0↑0,7
Semi Supervised Learning
CLS-based FT	81.22,7	41.71,3	76.33,2	79.53,8	65.112,6	91.70,4	80.35,8	26.77,8
+ TAPT	88.21,5↑7,0	43.42,6↑1,7	86.10,7↑9,8	86.22,4↑6,7	73.74,4↑8,6	94.21,5↑2,5	80.46,4↑0,1	1.92,4↓24,8
Prompt-based FT (hard)	92.71,3	46.71,5	86.21,2	90.70,8	80.86,9	91.01,1	84.74,4	7.25,5
+ TAPT	92.91,0↑0,2	48.91,1↑2,2	88.40,5↑2,2	89.82,3↓0,9	84.64,9↑3,8	93.51,1↑2,5	85.22,9↑0,5	1.43,5↓5,8
+ PCP (ours)	93.60,3↑0,9	50.91,3↑4,2	89.00,6↑2,8	92.30,4↑1,6	87.90,5↑7,1	95.70,4↑4,7	90.63,5↑5,9	25.02,9↑17,8
Prompt-based FT (soft)	92.51,2	48.00,7	86.81,4	90.81,3	81.26,8	90.32,1	83.03,0	4.93,7
+ TAPT	93.40,5↑0,9	47.01,2↓1,0	88.50,8↑1,7	89.63,4↓1,2	83.45,1↑2,2	93.30,7↑3,0	84.52,4↑1,5	2.11,8↓2,8
+ PCP (ours)	93.90,3↑1,4	50.71,3↑2,7	89.80,6↑3,0	92.00,5↑1,2	88.30,5↑7,1	94.90,9↑4,6	88.65,4↑5,6	21.52,5↑16,6
Sentence Pair Tasks
MNLI(acc)	MNLI-mm(acc)	SNLI(acc)	QNLI(acc)	RTE(acc)	MRPC(F1)	QQP(F1)	STS-B(Pear.)
Majority (full)	32.7	33.0	33.8	49.5	52.7	81.2	0.0	-
Prompt-based zero-shot†	50.8	51.7	49.5	50.8	51.3	61.9	49.7	-3.2
in-context learning	52.00,7	53.40,6	47.10,6	53.80,4	60.41,4	45.76,0	36.15,2	14.32,8
Fully Supervised Learning
CLS-based FT	82.1	82.7	88.1	90.2	83.4	91.9	79.7	91.2
+ TAPT	81.0↓1,1	82.0↓0,7	86.7↓1,4	85.6↓4,6	83.4↑0,0	91.6↓0,3	80.2↑0,5	90.4↓0,8
Prompt-based FT (hard)	85.4	85.8	89.0	89.6	88.1	93.1	73.8	91.5
+ TAPT	82.8↓2,6	83.2↓2,6	88.3↓0,7	90.9↑1,3	83.8↓4,3	92.7↓0,4	78.2↑4,4	91.2↓0,3
+ PCP (ours)	86.5↑1,1	86.2↑0,4	89.5↑0,5	91.5↑1,9	88.5↑0,4	93.3↑0,2	79.6↑5,8	91.9↑0,4
Prompt-based FT (soft)	84.6	85.4	89.0	89.5	84.5	92.4	73.9	91.6
+ TAPT	83.5↓1,1	84.1↓1,3	88.3↓0,7	90.9↑1,4	82.7↓1,8	92.6↑0,2	79.9↑6,0	90.9↓0,7
+ PCP (ours)	85.7↑1,1	86.0↑0,6	89.5↑0,5	91.0↑1,5	85.5↑1,0	92.6↑0,2	79.6↑5,7	91.7↑0,1
Semi Supervised Learning
CLS-based FT	46.20,6	48.51,0	45.65,4	61.48,2	54.24,3	73.28,7	58.53,8	46.016,3
+ TAPT	36.01,0↓10,2	36.31,1↓12,2	45.73,6↑0,1	55.62,7↓5,8	53.41,0↓0,8	67.78,5↓5,5	55.04,1↓3,5	48.119,6↑2,1
Prompt-based FT (hard)	67.31,3	68.91,2	76.71,6	66.54,3	68.33,1	75.91,6	66.81,9	67.78,1
+ TAPT	50.73,9↓16,6	52.24,6↓16,7	74.53,1↓2,2	55.31,1↓11,2	59.92,7↓8,4	63.26,3↓12,7	58.22,6↓8,6	63.18,0↓4,6
+ PCP (ours)	75.61,4↑8,3	76.80,9↑7,9	82.41,3↑5,7	85.10,8↑18,6	70.22,7↑1,9	80.73,3↑4,8	71.81,3↑5,0	71.58,4↑3,8
Prompt-based FT (soft)	62.72,2	65.91,2	75.40,8	64.24,7	68.23,7	73.010,6	66.51,8	63.76,8
+ TAPT	46.63,9↓16,1	49.56,8↓16,4	72.12,0↓3,3	55.02,3↓9,2	58.42,4↓9,8	63.35,8↓9,7	58.31,9↓8,2	65.36,3↑1,6
+ PCP (ours)	75.40,7↑12,7	76.80,3↑10,9	82.61,2↑7,2	84.32,0↑20,1	70.43,2↑2,2	80.02,4↑7,0	72.31,2↑5,8	71.47,8↑7,7
Summary of results: the probability of improving the performance for TAPT and PCP
Single Sentence Tasks	Sentence Pair Tasks
Checkpoint	TAPT(full)	PCP(full)	TAPT(semi)	PCP(semi)	TAPT(full)	PCP(full)	TAPT(semi)	PCP(semi)
CLS-based FT	87.5 (7/8)	-	87.5 (7/8)	-	25.0 (2/8)	-	25.0 (2/8)	-
Prompt-based FT (hard)	37.5 (3/8)	100 (8/8)	75.0 (6/8)	100 (8/8)	25.0 (2/8)	100 (8/8)	0.0 (0/8)	100 (8/8)
Prompt-based FT (soft)	50.0 (4/8)	100 (8/8)	62.5 (5/8)	100 (8/8)	37.5 (3/8)	100 (8/8)	12.5 (1/8)	100 (8/8)