Before revision:  We propose a number of explanations for these findings: LXMERT 's results on the image-sentence alignment task (and to a lesser extent those obtained by ViLBERT 12-in-1) indicate that the model may exhibit catastrophic URLetting . As for our results on the counting probe, we find evidence that all models are impacted by dataset bias, and also fail to individuate entities in the visual input   .
After revision:  We propose a number of explanations for these findings: LXMERT 's results on the image-sentence alignment task (and to a lesser extent those obtained by ViLBERT 12-in-1) show some evidence of catastrophic URLetting on task (1). Concerning our results on the counting probe, we find evidence that all models are impacted by dataset bias, and also fail to individuate entities in the visual input .