Table 1: Classification accuracy (%) on CIFAR10-C for 15 types of corruptions under five scenarios: Benign, Near, Far, Attack, and Noise. Benign contains only benign target samples, while other scenarios include both benign and each type of noisy samples specified. Bold numbers are the highest accuracy. Averaged over three different random seeds.
Method	Noise	Blur	Weather	Digital	Avg.
Gau.	Shot	Imp.	Def.	Gla.	Mot.	Zoom	Snow	Fro.	Fog	Brit.	Cont.	Elas.	Pix.	JPEG
Benign	Source	26.0	33.2	24.7	56.7	52.0	67.4	64.8	78.0	67.0	74.1	91.5	33.9	76.6	46.4	73.2	57.7
BN Stats [27]	67.0	69.0	60.4	87.8	65.6	86.3	87.4	81.6	80.3	85.4	90.7	86.9	76.7	79.3	71.9	78.4
PL [17]	71.1	72.9	62.2	86.9	64.4	85.3	86.6	80.8	78.8	84.9	89.6	84.0	76.2	80.0	73.1	78.5
TENT [38]	74.5	77.6	66.6	88.2	66.2	86.9	88.8	83.7	81.3	86.0	91.1	86.9	77.9	82.7	76.7	81.0
LAME [1]	21.8	29.2	19.7	53.3	52.1	65.9	62.5	79.2	69.3	73.1	90.1	28.0	75.7	43.8	74.1	55.9
CoTTA [39]	76.9	78.6	72.3	88.2	70.9	86.8	88.1	83.4	83.4	86.1	91.2	84.9	79.2	83.0	79.9	82.2
EATA [28]	76.0	78.2	68.2	88.4	70.1	87.4	88.4	84.5	85.0	88.0	91.5	89.9	77.8	84.8	78.4	82.4
SAR [29]	68.3	69.7	58.9	87.8	62.9	86.3	87.4	81.6	80.3	85.4	90.7	86.9	76.7	79.3	72.0	78.3
RoTTA [44]	65.2	67.4	58.3	87.2	64.4	85.8	87.3	81.2	76.9	85.3	90.7	57.2	76.5	77.7	71.6	75.5
SoTTA	75.0	77.5	68.8	88.8	70.7	87.5	89.0	85.4	84.0	88.2	91.9	83.9	79.8	83.9	78.3	82.2
Near	Source	26.0	33.2	24.7	56.7	52.0	67.4	64.8	78.0	67.0	74.1	91.5	33.9	76.6	46.4	73.2	57.7
BN Stats [27]	64.9	66.3	58.2	84.1	62.7	84.2	85.0	83.1	82.5	85.5	92.4	85.3	76.5	67.4	70.3	76.6
PL [17]	63.2	63.5	51.7	81.6	58.4	78.4	83.3	79.2	79.7	80.3	89.2	79.5	73.1	70.9	69.3	73.4
TENT [38]	64.7	64.7	50.2	81.3	59.6	80.8	83.8	79.6	78.3	80.0	88.6	83.7	73.5	74.3	71.1	74.3
LAME [1]	24.3	31.6	19.9	53.9	53.2	65.9	62.5	79.0	69.5	73.1	90.1	28.4	75.0	44.8	74.2	56.4
CoTTA [39]	72.7	74.3	66.0	82.6	67.6	81.8	84.1	84.1	85.5	82.5	91.1	69.9	78.1	76.1	79.3	78.4
EATA [28]	51.5	50.3	40.1	70.4	45.8	72.8	77.2	66.8	67.4	74.4	83.9	68.2	60.2	67.3	62.1	63.9
SAR [29]	59.0	60.9	52.8	78.2	55.4	83.7	81.8	78.8	78.6	85.5	92.4	85.3	66.6	64.0	63.8	72.4
RoTTA [44]	66.3	68.3	59.4	86.0	63.2	85.4	87.0	83.5	82.8	86.4	92.4	84.8	77.1	71.6	71.6	77.7
SoTTA	74.3	76.7	66.5	87.5	66.9	86.4	87.8	84.4	83.8	87.2	91.3	88.4	78.7	82.4	78.0	81.4
Far	Source	26.0	33.2	24.7	56.7	52.0	67.4	64.8	78.0	67.0	74.1	91.5	33.9	76.6	46.4	73.2	57.7
BN Stats [27]	62.7	66.1	56.0	86.5	60.7	84.2	87.2	79.8	78.4	85.7	89.9	80.2	75.5	69.8	65.0	75.2
PL [17]	55.2	54.1	48.3	83.2	49.3	80.0	83.0	76.8	73.3	80.6	87.6	74.6	70.5	66.8	63.6	69.8
TENT [38]	51.6	57.4	43.7	84.8	43.5	83.3	85.3	80.4	73.1	83.5	88.9	80.8	73.5	72.2	66.7	71.2
LAME [1]	22.8	29.6	19.3	53.2	50.4	64.6	60.7	79.1	67.9	72.8	90.1	28.1	74.7	44.4	74.3	55.5
CoTTA [39]	67.4	71.1	59.4	83.3	61.2	82.3	84.3	80.4	80.4	83.8	87.2	58.0	76.0	70.3	72.9	74.5
EATA [28]	40.0	46.4	34.9	73.5	35.2	59.3	76.4	61.1	59.5	68.4	85.2	55.2	46.5	53.5	49.0	56.3
SAR [29]	60.3	62.6	50.9	86.5	55.4	84.3	87.2	79.8	78.3	85.7	89.9	80.2	70.1	67.8	60.9	73.3
RoTTA [44]	67.3	69.8	61.1	88.1	66.0	86.6	88.0	82.0	78.8	86.2	91.2	61.7	77.5	79.6	73.0	77.1
SoTTA	73.3	76.3	66.3	88.5	68.3	86.8	88.3	84.1	84.2	87.2	92.0	89.0	77.8	83.8	77.8	81.6
Attack	Source	26.0	33.2	24.7	56.7	52.0	67.4	64.8	78.0	67.0	74.1	91.5	33.9	76.6	46.4	73.2	57.7
BN Stats [27]	44.5	46.8	39.8	63.3	42.1	63.5	62.5	62.3	59.3	62.1	75.4	65.1	50.6	53.9	46.9	55.9
PL [17]	59.1	61.4	53.1	73.1	51.9	71.7	72.3	71.3	69.1	69.8	81.5	72.1	60.9	67.4	60.1	66.3
TENT [38]	62.9	65.2	56.7	74.8	54.5	73.4	75.2	73.8	71.8	72.1	83.0	73.7	63.1	70.0	64.0	68.9
LAME [1]	21.0	28.0	17.3	52.7	52.9	65.9	62.0	79.3	70.4	73.9	90.3	28.4	75.6	44.2	74.2	55.9
CoTTA [39]	53.1	57.0	49.7	67.9	55.9	69.7	71.3	74.3	69.5	68.1	84.9	47.0	68.6	62.3	71.6	69.5
EATA [28]	66.6	68.7	57.9	75.2	57.2	74.7	75.5	75.1	73.5	73.8	83.5	76.0	64.3	73.5	67.8	70.9
SAR [29]	46.1	48.1	40.3	63.3	42.2	63.5	62.5	62.3	59.3	62.1	75.4	65.1	50.6	53.9	47.6	56.2
RoTTA [44]	69.7	71.8	62.9	88.6	67.8	87.4	88.7	83.2	80.1	87.1	91.8	63.5	78.4	80.6	74.1	78.4
SoTTA	78.2	80.8	72.3	90.1	73.6	89.2	90.3	87.4	86.2	89.3	92.9	87.8	81.3	86.6	81.0	84.5
Noise	Source	26.0	33.2	24.7	56.7	52.0	67.4	64.8	78.0	67.0	74.1	91.5	33.9	76.6	46.4	73.2	57.7
BN Stats [27]	51.7	53.9	45.5	52.7	41.5	51.0	55.1	62.8	63.8	53.8	76.9	55.8	46.8	54.8	56.4	54.8
PL [17]	47.6	52.7	44.7	48.9	36.1	49.4	54.1	61.9	56.5	50.9	77.1	45.2	43.1	49.4	59.5	51.8
TENT [38]	54.0	57.1	36.7	48.9	28.3	50.5	51.0	64.0	64.7	49.5	80.5	43.7	38.4	56.7	57.0	52.1
LAME [1]	21.8	28.6	18.5	51.6	50.8	64.3	60.9	78.4	67.3	71.7	90.5	27.0	75.1	43.0	73.4	54.9
CoTTA [39]	60.4	60.3	52.4	47.3	41.6	44.1	52.0	62.7	66.6	47.7	79.0	44.7	42.8	60.2	60.2	54.8
EATA [28]	42.2	41.0	33.2	32.7	25.0	27.9	34.3	40.8	42.6	31.6	61.5	20.3	27.5	35.8	43.1	36.0
SAR [29]	57.5	59.3	49.6	57.2	43.7	54.4	59.4	64.8	65.4	57.9	77.1	60.2	50.0	58.3	59.8	58.3
RoTTA [44]	64.4	66.9	56.1	80.1	59.1	79.8	82.2	79.7	78.7	77.8	91.2	69.0	72.3	73.4	72.8	73.6
SoTTA	73.3	77.7	66.8	86.1	64.0	84.3	86.6	83.1	82.0	85.7	91.1	84.1	77.1	81.6	77.2	80.0