Before revision:  All examined models greatly under-perform humans in retrieval, highlighting substantial room for future progress. Altogether, our findings shed new empirical insights on language grounding and its materialization in contextual language models.
After revision:  All examined models greatly under-perform humans . We hope our analyses inspire future research in understanding and improving the visual capabilities of language models.