Before revision:  In the pursuit of advancing fluid human-AI communication, we propose a new challenge, RICA  , that evaluates the capabilities of making commonsense inferences and the robustness of these inferences to language variations. In our work , we develop a systematic procedure to probe PTLMs across three different evaluation settings.
After revision:  In the pursuit of advancing fluid human-AI communication, we propose a new challenge, RICA , that evaluates robust commonsense inference despite textual perturbations. To generate data for this challenge , we develop a systematic procedure to probe PTLMs across three different evaluation settings.