Before revision:  In our work , we develop a systematic procedure to probe PTLMs across three different evaluation settings.
After revision:  In our work , we develop a systematic and scalable procedure using commonsense knowledge bases and probe PTLMs across three different evaluation settings.