Table 6: Classification accuracy (%) and their corresponding standard deviations on CIFAR100-C for 15 types of corruptions under five scenarios. Bold numbers are the highest accuracy. Averaged over three different random seeds.
Method	Noise	Blur	Weather	Digital	Avg.
Gau.	Shot	Imp.	Def.	Gla.	Mot.	Zoom	Snow	Fro.	Fog	Brit.	Cont.	Elas.	Pix.	JPEG
Source	10.6 ±1.3	12.1 ±1.2	7.2 ±0.9	34.9 ±0.3	19.6 ±0.6	44.1 ±0.6	41.9 ±0.4	46.3 ±0.2	34.2 ±0.4	41.1 ±0.9	67.3 ±0.1	18.5 ±0.6	50.4 ±0.3	24.9 ±2.5	44.6 ±0.6	33.2 ±0.4
BN stats [27]	39.2 ±0.9	40.7 ±0.6	34.1 ±0.7	66.1 ±0.1	42.5 ±0.4	63.6 ±0.6	64.8 ±0.1	53.8 ±0.5	53.5 ±0.2	58.1 ±0.3	68.2 ±0.2	64.5 ±0.5	53.9 ±0.4	56.6 ±0.7	45.2 ±0.3	53.7 ±0.2
PL [17]	46.5 ±0.2	48.7 ±0.9	40.8 ±1.2	66.3 ±0.5	45.5 ±1.2	63.7 ±0.7	65.7 ±0.6	56.8 ±0.6	55.1 ±0.6	61.0 ±0.2	68.6 ±0.8	64.6 ±0.6	54.6 ±0.5	60.9 ±0.4	49.6 ±0.3	56.6 ±0.2
TENT [38]	50.0 ±0.5	52.0 ±0.8	44.2 ±0.5	67.9 ±0.3	48.7 ±0.5	66.1 ±0.5	68.0 ±0.4	59.7 ±0.5	59.3 ±0.3	63.4 ±0.2	70.8 ±0.3	67.3 ±0.3	57.5 ±0.4	63.6 ±0.3	53.7 ±0.2	59.5 ±0.0
Benign LAME [1]	7.8 ±1.7	9.0 ±1.7	5.9 ±0.8	31.6 ±0.3	16.6 ±0.6	42.3 ±0.8	39.8 ±0.5	45.5 ±0.2	31.7 ±1.0	38.3 ±1.1	66.4 ±0.3	15.1 ±0.6	49.5 ±0.4	21.6 ±2.8	43.9 ±0.7	31.0 ±0.5
CoTTA [39]	47.5 ±0.4	48.5 ±0.5	43.2 ±0.5	64.0 ±0.3	46.4 ±0.8	61.7 ±0.8	62.8 ±0.3	55.3 ±0.8	56.1 ±0.6	56.7 ±0.4	68.1 ±0.1	58.4 ±0.7	54.3 ±0.1	60.2 ±0.4	53.4 ±0.2	55.8 ±0.4
EATA [28]	11.1 ±1.7	12.2 ±1.3	7.2 ±0.2	35.0 ±1.2	10.4 ±1.0	31.5 ±4.6	39.6 ±7.0	21.6 ±1.8	17.9 ±2.0	23.6 ±3.2	56.4 ±5.5	34.7 ±1.9	15.2 ±1.4	21.7 ±3.4	14.7 ±1.1	23.5 ±1.9
SAR [29]	46.5 ±0.6	48.5 ±0.8	40.9 ±0.7	67.4 ±0.2	46.1 ±0.6	64.9 ±0.8	66.3 ±0.3	56.9 ±0.5	56.4 ±0.3	61.2 ±0.4	69.8 ±0.2	66.8 ±0.5	56.1 ±0.3	60.3 ±0.4	58.8 ±0.3	57.3 ±0.3
RoTTA [44]	35.7 ±1.2	36.9 ±1.1	31.6 ±1.0	63.9 ±0.3	40.3 ±0.2	61.6 ±0.7	63.0 ±0.8	51.2 ±0.5	44.1 ±0.9	56.4 ±0.2	66.1 ±0.5	31.5 ±1.4	52.3 ±0.6	52.9 ±1.1	43.1 ±0.6	48.7 ±0.6
SoTTA	52.0 ±0.6	53.4 ±0.4	45.0 ±1.1	68.8 ±0.2	49.1 ±0.8	66.7 ±0.6	69.0 ±0.2	61.7 ±0.6	60.2 ±0.2	64.7 ±0.6	72.2 ±0.3	66.4 ±0.5	58.6 ±0.5	64.1 ±0.2	55.0 ±0.4	60.5 ±0.4
Near LAME [1]	10.6 ±1.3	12.1 ±1.2	7.2 ±0.9	34.9 ±0.3	19.6 ±0.6	44.1 ±0.6	41.9 ±0.4	46.3 ±0.2	34.2 ±0.4	41.1 ±0.9	67.3 ±0.1	38.5 ±0.6	50.4 ±0.3	24.9 ±2.5	44.6 ±0.6	33.2 ±0.4
CoTTA [39]	36.0 ±0.6	37.1 ±0.6	31.5 ±1.0	58.6 ±0.3	37.7 ±0.2	58.2 ±0.8	60.1 ±0.8	56.1 ±0.4	56.1 ±0.4	56.6 ±0.3	71.7 ±0.3	54.9 ±0.5	52.4 ±0.7	49.8 ±0.7	45.4 ±0.6	50.8 ±0.1
PL [17]	32.4 ±2.0	32.1 ±2.1	26.5 ±1.7	58.4 ±1.8	33.5 ±0.6	56.9 ±1.5	58.8 ±1.9	51.5 ±0.6	50.5 ±1.5	53.4 ±2.0	66.7 ±1.2	51.4 ±3.9	49.3 ±0.9	53.1 ±0.5	45.3 ±0.8	48.0 ±0.3
TENT [38]	26.8 ±5.6	27.1 ±0.6	21.4 ±2.9	58.7 ±2.1	24.5 ±1.1	58.0 ±1.1	60.8 ±1.8	50.6 ±1.1	47.7 ±2.2	52.6 ±2.1	66.3 ±1.2	58.2 ±0.0	46.2 ±1.0	52.1 ±1.0	44.5 ±1.6	46.4 ±1.4
Far LAME [1]	8.1 ±1.6	9.6 ±1.6	5.9 ±0.9	32.6 ±0.4	17.2 ±0.5	43.0 ±0.6	40.4 ±0.6	45.7 ±0.4	32.7 ±0.7	39.1 ±0.8	66.8 ±0.1	15.6 ±0.6	49.8 ±0.4	22.3 ±2.5	44.0 ±0.6	31.5 ±0.5
CoTTA [39]	40.5 ±0.8	41.3 ±0.3	36.9 ±0.5	51.5 ±0.6	39.5 ±0.4	53.4 ±0.4	54.8 ±0.9	56.8 ±0.4	57.2 ±0.5	52.6 ±0.8	67.3 ±0.1	38.2 ±0.5	51.3 ±0.9	56.4 ±0.1	52.7 ±0.3	50.0 ±0.3
EATA [28]	4.5 ±0.9	4.3 ±0.3	3.6 ±0.3	7.4 ±0.4	4.9 ±0.3	7.6 ±1.3	7.5 ±0.6	7.0 ±1.3	5.7 ±1.0	5.8 ±0.2	6.9 ±1.3	5.2 ±0.4	6.6 ±0.3	5.7 ±0.5	5.7 ±0.7	6.1 ±0.3
SAR [29]	43.3 ±0.1	44.6 ±0.7	38.3 ±0.9	62.6 ±0.5	40.5 ±0.3	61.5 ±0.4	63.5 ±0.8	58.6 ±0.5	58.5 ±0.1	61.4 ±0.4	72.1 ±0.3	62.0 ±0.3	54.6 ±0.1	57.5 ±1.3	51.6 ±1.3	55.4 ±0.7
RoTTA [44]	36.6 ±0.7	38.6 ±0.4	30.5 ±1.5	64.0 ±0.4	38.1 ±0.1	61.9 ±0.6	63.7 ±0.5	55.1 ±1.0	50.3 ±2.2	58.4 ±0.3	68.2 ±0.6	26.6 ±1.1	52.7 ±0.6	52.3 ±1.2	44.3 ±1.0	49.4 ±0.5
SoTTA	47.2 ±1.1	48.5 ±0.7	40.4 ±1.8	64.8 ±0.4	42.4 ±0.3	63.4 ±0.3	65.8 ±0.5	59.1 ±0.3	58.2 ±0.6	62.2 ±0.5	70.8 ±0.3	65.8 ±0.5	54.3 ±0.1	60.7 ±0.4	53.4 ±0.7	57.1 ±0.2
Source	10.6 ±1.3	12.1 ±1.2	7.2 ±0.9	34.9 ±0.3	19.6 ±0.6	44.1 ±0.6	41.9 ±0.4	46.3 ±0.2	34.2 ±0.4	41.1 ±0.9	67.3 ±1.1	18.5 ±0.6	50.4 ±0.3	24.9 ±2.5	44.6 ±0.6	33.2 ±0.4
BN stats [27]	32.5 ±0.4	34.4 ±0.4	27.9 ±0.7	59.1 ±0.3	34.2 ±0.3	56.3 ±0.8	59.6 ±0.2	48.4 ±0.1	48.6 ±0.4	53.5 ±0.4	64.1 ±0.6	51.9 ±0.7	47.6 ±0.4	46.9 ±0.4	37.0 ±0.4	46.8 ±0.1
PL [17]	24.7 ±1.9	26.3 ±1.6	19.7 ±1.1	57.6 ±2.7	26.1 ±1.7	53.7 ±1.7	57.5 ±1.7	47.2 ±0.8	44.0 ±0.5	50.2 ±1.4	62.1 ±1.8	48.1 ±0.7	42.0 ±2.1	45.6 ±1.3	37.0 ±1.3	42.8 ±0.7
TENT [38]	17.3 ±2.1	16.9 ±2.0	13.9 ±1.6	57.5 ±2.2	19.8 ±1.1	55.0 ±0.5	60.0 ±0.6	39.9 ±5.2	40.8 ±2.9	49.8 ±2.7	63.6 ±4.5	51.6 ±4.5	37.0 ±2.7	44.5 ±3.7	32.7 ±3.6	40.0 ±1.3
SAR [29]	37.4 ±0.4	38.9 ±1.1	32.2 ±0.8	62.3 ±0.3	36.9 ±0.3	60.3 ±0.4	63.3 ±0.4	51.8 ±0.3	52.5 ±0.1	56.7 ±0.4	66.8 ±0.4	41.9 ±0.9	49.2 ±0.3	22.1 ±2.6	43.3 ±0.7	30.8 ±0.7
RoTTA [44]	39.3 ±2.4	40.6 ±2.2	35.2 ±2.2	64.7 ±0.3	42.3 ±1.6	62.4 ±0.6	63.7 ±0.5	51.8 ±1.0	45.3 ±2.2	58.4 ±0.9	68.2 ±0.6	26.6 ±1.1	52.7 ±0.6	52.3 ±1.1	44.3 ±0.9	49.8 ±0.9
SoTTA	50.8 ±1.1	51.5 ±0.9	42.3 ±0.5	66.9 ±0.5	46.2 ±1.0	64.5 ±0.3	67.3 ±0.3	60.3 ±0.0	59.5 ±0.5	62.2 ±0.1	70.8 ±0.6	68.6 ±0.9	55.8 ±0.4	62.5 ±0.4	54.0 ±1.1	59.0 ±0.4
Source	10.6 ±1.3	12.1 ±1.2	7.2 ±0.9	34.9 ±0.3	19.6 ±0.6	44.1 ±0.6	41.9 ±0.4	46.3 ±0.2	34.2 ±0.4	41.1 ±0.9	67.3 ±:1.1	18.5 ±0.6	50.4 ±0.3	24.9 ±2.5	44.6 ±0.6	33.2 ±0.4
BN stats [27]	19.0 ±0.4	19.5 ±0.4	15.6 ±0.7	36.2 ±0.3	20.3 ±0.3	37.7 ±0.4	36.2 ±0.6	31.2 ±0.1	30.1 ±0.4	31.2 ±0.4	45.8 ±0.4	35.2 ±0.1	28.0 ±0.4	30.8 ±0.7	21.8 ±0.5	29.2 ±0.4
PL [17]	33.8 ±1.3	34.8 ±0.8	29.0 ±0.5	43.8 ±1.3	29.3 ±0.4	44.4 ±0.2	45.1 ±0.7	41.9 ±0.4	40.1 ±0.4	39.8 ±0.2	53.7 ±0.4	39.8 ±0.3	46.0 ±0.7	42.5 ±0.2	35.3 ±0.6	39.3 ±0.4
TENT [38]	28.7 ±0.9	29.9 ±1.0	23.3 ±0.4	37.0 ±1.0	21.7 ±0.7	36.5 ±0.8	37.4 ±0.4	34.4 ±0.2	32.6 ±0.7	30.7 ±0.4	46.4 ±1.5	29.1 ±0.6	26.5 ±1.0	35.1 ±0.8	29.0 ±0.3	31.9 ±0.7
SAR [29]	37.4 ±0.5	38.9 ±0.6	32.2 ±0.3	66.9 ±0.6	38.9 ±0.5	63.3 ±0.4	63.7 ±0.5	51.8 ±0.4	52.5 ±0.7	56.7 ±0.4	66.3 ±0.2	15.0 ±0.7	49.4 ±0.4	21.5 ±0.8	43.7 ±0.8	31.0 ±0.5
RoTTA [44]	40.5 ±0.9	41.7 ±0.7	35.9 ±0.9	66.2 ±0.3	43.5 ±0.1	64.1 ±0.7	65.5 ±0.4	54.5 ±0.9	49.5 ±1.3	57.4 ±0.9	66.2 ±0.9	26.3 ±0.7	52.6 ±0.6	55.2 ±1.1	44.0 ±0.9	49.8 ±0.4
SoTTA	54.3 ±0.7	55.6 ±0.7	47.6 ±0.2	69.6 ±0.2	51.6 ±0.5	67.8 ±0.1	69.7 ±0.2	62.7 ±0.3	61.7 ±0.5	66.2 ±0.1	70.8 ±0.1	68.3 ±0.9	59.4 ±1.2	65.3 ±0.4	56.5 ±1.1	61.9 ±0.0
Source	10.6 ±1.3	12.1 ±1.2	7.2 ±0.9	34.9 ±0.3	19.6 ±0.6	44.1 ±0.6	41.9 ±0.4	46.3 ±0.2	34.2 ±0.4	41.1 ±0.9	67.3 ± 0.1	18.5 ±0.6	50.4 ±0.3	24.9 ±2.5	44.6 ±0.6	33.2 ±0.4
BN stats [27]	25.5 ±1.0	25.5 ±0.9	20.8 ±0.9	28.2 ±0.5	22.0 ±0.1	28.4 ±0.3	31.0 ±0.4	30.7 ±0.6	32.6 ±0.3	24.5 ±0.2	45.8 ±0.5	25.8 ±0.2	26.3 ±0.3	29.4 ±0.8	29.4 ±0.6	28.3 ±0.3
PL [17]	21.4 ±2.4	25.6 ±2.4	15.8 ±2.1	22.5 ±2.1	16.1 ±2.2	19.8 ±2.2	23.8 ±1.0	28.1 ±0.3	30.7 ±0.5	21.1 ±0.4	47.4 ±1.6	14.0 ±2.1	21.6 ±2.6	26.4 ±1.5	23.4 ±2.6	23.8 ±0
TENT [38]	16.4 ±3.0	17.3 ±3.5	11.3 ±3.3	20.1 ±4.2	11.2 ±2.1	17,8 ±2,3	24,3 ±1,9	20,0 ±2,7	24,6 ±4,6	16,3 ±1,8	50,9 ±1,8	13,5 ±1,8	23,5 ±0,8	25,3 ±1,8	21,5 ±1,8	20,0 ±1,9
SAR [29]	27.0 ±0,5	28.2 ±0,6	23.1 ±0,3	40.7 ±0,6	24,3 ±0,1	40,8 ±0,1	40,6 ±0,5	35,9 ±0,5	34,7 ±0,3	35,6 ±0,4	49,3 ±0,2	39,4 ±0,1	31,0 ±0,3	37,1 ±0,6	38,3 ±0,6	34,7 ±0,3
RoTTA [44]	40,5 ±0,9	41,7 ±0,7	35,9 ±0,9	66,2 ±0,3	43,5 ±0,1	64,1 ±0,7	65,5 ±0,4	54,5 ±0,3	49,5 ±1,3	59,8 ±0,5	68,3 ±0,4	25,7 ±0,1	54,7 ±0,1	56,6 ±0,6	46,2 ±0,7	51,5 ±0,9
SoTTA	54,3 ±0,7	55,6 ±0,7	47,6 ±0,2	69,6 ±0,2	51,6 ±0,5	67,8 ±0,1	69,7 ±0,2	62,7 ±0,3	61,7 ±0,3	66,2 ±0,1	72,5 ±0,1	68,3 ±0,9	59,4 ±1,2	65,3 ±0,4	56,5 ±1,4	61,9 ±0,9