Before revision:  However, to what extent is the information encoded in a sentence representation actually used for the task which the encoder is trained on ? In this work, we examine this probing paradigm through a case-study in Natural Language Inference, showing that models  learn to encode linguistic properties even when not needed for a task .
After revision:  However, to what extent is the information encoded in sentence representations, as discovered through a probe, actually used by the model to perform its task ? In this work, we examine this probing paradigm through a case-study in Natural Language Inference, showing that models learn to encode linguistic properties even when not needed for a task .