SlowGuess/NAACL_2021_OCR huggingface dataset:
Table 2: SPP Perturbation: Standard (Std.) and Robust (Rob.) performance of the Bisk et al. (2016) model  $(M_{std})$  and its robust counterpart  $(M_{rob})$  for the different perturbations  $(\mathcal{P})$ :  $SPP - i$  denotes the perturbation set contains  $i$  additional permutations of the original input.  $\downarrow$  denotes lower is better.  $RI$  denotes the relative improvement in robust evaluation of the robust model w.r.t. the standard model.  $BD$  denotes the block-distance measure. The bold numbers are the best robust performance for each  $\mathcal{P}$ .
P	Model	Source(Acc) ↑
Std.	Rob.	RI(%)
R(1)	M_std	48.89	18.5	52.59
Mrob	53.61	28.23
R(2)	M_std	48.89	10.01	61.14
Mrob	53.89	16.13
R(3)	M_std	48.89	6.12	165.85
Mrob	53.19	16.27
A(1)	M_std	48.89	19.33	22.30
Mrob	49.31	23.64
Table 3: SPC Perturbation: Standard (Std.) and Robust (Rob.) performance of the Tan and Bansal (2018) model ( $M_{std}$ ) and its robust counterpart ( $M_{rob}$ ) for the different perturbations ( $\mathcal{P}$ ):  $A(i)$  and  $R(i)$  denotes the addition and removal of  $i$  blocks respectively.  $\uparrow$  denotes higher is better.