Table 5: Classification accuracy (%) and their corresponding standard deviations on CIFAR10-C for 15 types of corruptions under five scenarios. Bold numbers are the highest accuracy. Averaged over three different random seeds.
Method	Noise	Blur	Weather	Digital	Avg.
Gau.	Shot	Imp.	Def.	Gla.	Mot.	Zoom	Snow	Fro.	Fog	Brit.	Cont.	Elas.	Pix.	JPEG
Source	26.0	33.2	24.7	56.7	52.0	67.4	64.8	78.0	67.0	74.1	91.5	33.9	76.6	46.4	73.2	57.7
BN Stats [27]	±3.3	±3.5	±4.2	±2.7	±2.7	±1.2	±2.6	±0.4	±2.5	±0.8	±0.3	±1.8	±0.7	±0.6	±0.8	±1.0
67.0	69.0	60.4	87.8	65.6	86.3	87.4	81.6	80.3	85.4	90.7	86.9	76.7	79.3	71.9	78.4
±0.5	±0.8	±0.9	±0.2	±0.7	±0.1	±0.4	±0.4	±0.5	±0.6	±0.2	±0.4	±0.2	±0.0	±0.6	±0.3
PL [17]	71.1	72.9	62.2	86.9	64.4	85.3	86.6	80.8	78.8	84.9	89.6	84.0	76.2	80.0	73.1	78.5
±1.2	±0.6	±1.3	±0.0	±0.4	±1.2	±0.9	±1.0	±1.8	±0.3	±1.0	±0.2	±0.6	±0.7	±1.4	±0.3
TENT [38]	74.5	77.6	66.6	88.2	66.2	86.9	88.8	83.7	81.3	86.0	91.1	86.9	77.9	82.7	76.7	81.0
±0.7	±0.8	±1.3	±0.3	±2.0	±0.8	±0.4	±0.5	±1.3	±1.5	±0.4	±0.6	±0.3	±0.9	±1.4	±0.4
Benign LAME [1]	21.8	29.2	19.7	53.3	52.1	65.9	62.5	79.2	69.3	73.1	90.1	28.0	75.7	43.8	74.1	55.9
±3.6	±4.0	±4.7	±1.6	±3.7	±0.3	±1.4	±0.7	±4.4	±1.7	±0.3	±1.1	±0.7	±1.1	±0.9	±0.5
CoTTA [39]	76.9	78.6	72.3	88.2	70.9	86.8	88.1	83.4	83.4	86.1	91.2	84.9	79.2	83.0	79.9	82.2
±0.6	±0.1	±0.2	±0.5	±1.0	±0.2	±0.5	±0.3	±0.5	±0.5	±0.2	±0.2	±0.5	±0.3	±0.6	±0.2
EATA [28]	76.0	78.2	68.2	88.4	70.1	87.4	88.4	84.5	85.0	88.0	91.5	89.9	77.8	84.8	78.4	82.4
±0.8	±0.8	±0.7	±0.2	±1.9	±0.5	±0.1	±0.3	±0.3	±0.2	±0.3	±0.6	±0.5	±0.5	±1.2	±0.2
SAR [29]	68.3	69.7	58.9	87.8	62.9	86.3	87.4	81.6	80.3	85.4	90.7	86.9	76.7	79.3	72.0	78.3
±1.2	±1	±69	±0.2	±5.3	±0.1	±0.4	±0.4	±0.5	±0.6	±0.2	±0.5	±0.2	±0.0	±0.5	±0.7
RoTTA [44]	65.2	67.4	58.3	87.2	64.4	85.8	87.3	81.2	76.9	85.3	90.7	57.2	76.5	77.7	71.6	75.5
±0.8	±1.1	±0.9	±0.2	±1.2	±0.3	±0.5	±1	±1	±0.6	±0.5	±2.9	±0.3	±0.4	±0.9	±0.7
SoTTA	75.0	77.5	68.8	88.8	70.7	87.5	89.0	85.4	84.0	88.2	91.9	83.9	79.8	83.9	78.3	82.2
±1.1	±0.6	±0.7	±0.4	±1.2	±0.5	±0.5	±0.3	±0.7	±0.2	±0.1	±1.5	±0.4	±0.5	±0.7	±0.3
Near LAME [1]	26.0	33.2	24.7	56.7	52.0	67.4	64.8	78.0	67.0	74.1	91.5	33.9	76.6	46.4	73.2	57.7
±3.3	±3.5	±4.2	±2.7	±2.7	±1.2	±2.6	±0.4	±2.5	±0.8	±0.3	±1.8	±0.7	±0.6	±0.8	±1.0
BN Stats [27]	64.9	66.3	58.2	84.1	62.7	84.2	85.0	83.1	82.5	85.5	92.4	85.3	76.5	67.4	70.3	76.6
±0.8	±0.9	±0.7	±0.5	±0.6	±0.4	±0.2	±0.6	±0.5	±0.5	±0.1	±0.2	±0.6	±0.3	±1.0	±0.4
PL [17]	63.2	63.5	51.7	81.6	58.4	78.4	83.3	79.2	79.7	80.3	89.2	79.5	73.1	70.9	69.3	73.4
±1.0	±3.4	±4.4	±1.0	±1.5	±1.6	±0.6	±0.5	±2.1	±1.9	±1.1	±0.1	±1.6	±0.6	±1.7	±0.2
TENT [38]	64.7	64.7	50.2	81.3	59.6	80.8	83.8	79.6	78.3	80.0	88.6	83.7	73.5	74.3	71.1	74.3
±3.6	±5.4	±4.9	±2.3	±2.9	±1.1	±1.0	±1.1	±2.7	±3.8	±1.0	±1.4	±1.0	±0.5	±2.8	±0.9
SoTTA [39]	24.3	31.6	19.9	53.9	53.2	65.9	62.5	79.0	69.5	73.1	90.1	28.4	75.0	44.8	74.2	56.4
±3.0	±3.3	±4.3	±1.4	±3.6	±0.7	±1.2	±0.4	±3.8	±1.5	±0.2	±1.1	±0.7	±1.0	±1.1	±0.6
CoTTA [39]	72.7	74.3	66.0	82.6	67.6	81.8	84.1	84.1	85.5	82.5	91.1	69.9	78.1	76.1	79.3	78.4
±0.2	±0.7	±0.1	±0.6	±0.9	±0.5	±0.4	±0.8	±0.3	±1.1	±0.3	±0.5	±1.0	±0.5	±0.7	±0.4
EATA [28]	51.5	50.3	40.1	70.4	45.8	72.8	77.2	66.8	67.4	74.4	83.9	68.2	60.2	67.3	62.1	63.9
±3.4	±2.4	±2.2	±5.6	±2.4	±0.9	±1.4	±2.0	±5.0	±1.2	±1.2	±7.5	±1.8	±2.0	±5.4	±0.4
SAR [29]	59.0	60.9	52.8	78.2	55.4	83.7	81.8	78.8	78.6	85.5	92.4	85.3	66.6	64.0	63.8	72.4
±15.4	±14.3	±14.4	±100	±14.7	±0.7	±5.7	±7.2	±6.7	±0.5	±0.1	±0.1	±17.8	±12.2	±14.4	±8.8
RoTTA [44]	66.3	68.3	59.4	86.0	63.2	85.4	87.0	83.5	82.8	86.4	92.4	84.8	77.1	71.6	71.6	77.7
±0.7	±13	±0.7	±0.4	±0.7	±0.3	±0.4	±0.8	±0.7	±0.5	±0.3	±1.4	±0.8	±0.4	±0.6	±0.6
SoTTA [39]	74.3	76.7	66.5	87.5	66.9	86.4	87.8	84.4	83.8	87.2	91.3	88.4	78.7	82.4	78.0	81.4
±1.4	±0.9	±2.2	±0.1	±0.8	±0.6	±0.5	±0.6	±0.2	±0.5	±0.2	±0.7	±1.1	±0.5	±0.6	±0.5
Far LAME [1]	26.0	33.2	24.7	56.7	52.0	67.4	64.8	78.0	67.0	74.1	91.5	33.9	76.6	46.4	73.2	57.7
±3.3	±3.5	+4.2	±2.7	±2.7	±1.2	±2.6	±0.4	±2.5	±0.8	±0.3	±1.8	±0.7	±0.6	±0.8	±1.0
BN Stats [27]	62.7	66.1	56.0	86.5	60.7	84.2	87.2	79.8	78.4	85.7	89.9	80.2	75.5	69.8	65.0	75.2
±1.3	±1.4	±0.9	±0.2	±0.7	±0.8	±0.1	±0.4	±0.6	±0.2	±0.0	±1.0	±0.6	±1.0	±0.1	±0.3
PL [17]	55.2	54.1	48.3	83.2	49.3	80.0	83.0	76.8	73.3	80.6	87.6	74.6	70.5	66.8	63.6	69.8
±2.9	±5.2	±5.2	±0.8	±4.4	±2.4	±1.9	±1.2	±2.8	±1.9	±1.4	±2.0	±2.7	±5.9	±2.6	±1.5
TENT [38]	51.6	57.4	43.7	84.8	43.5	83.3	85.3	80.4	73.1	83.5	88.9	80.8	73.5	72.2	66.7	71.2
±8.6	±6.2	±11.4	±0.8	±7.5	±0.6	±0.6	±1.1	±3.5	±0.4	±0.4	±7.5	±1.7	±2.4	±4.3
SoTTA [39]	22.8	29.6	19.3	53.2	50.4	64.6	60.7	79.1	67.9	72.8	90.1	28.1	74.7	44.4	74.3	55.5
±3.4	±3.7	±4.2	±1.6	±3.7	±0.8	±1.2	±0.7	±4.0	±1.5	±0.2	±1.1	±0.8	±0.7
CoTTA [39]	67.4	71.1	59.4	83.3	61.2	82.3	84.3	80.4	80.4	83.8	87.2	58.0	76.0	70.3	72.9	74.5
±1.9	±1.0	±2.7	±0.5	±0.6	±0.9	±0.3	±1.2	±1.5	±1.3	±1.4	±4.7	±0.4	±3.5
EATA [28]	40.0	46.4	34.9	73.5	35.2	59.3	76.4	61.1	59.5	68.4	85.2	55.2	46.5	53.5	49.0
±2.3	±3.9