Before revision:  However, to what extent is the information encoded in a sentence representation actually used for the task which the encoder is trained on ? In this work, we examine this probing paradigm through a case-study in Natural Language Inference, showing that models  learn to encode linguistic properties even when not needed for a task .
After revision:  However, to what extent is the information encoded in a sentence representation actually used for the task which the encoder is trained on ? In this work, we examine this probing paradigm through a case-study in Natural Language Inference, showing that models can learn to encode linguistic properties even when not needed for a task .