Task: Linguistic Probing
Input (English): He'd lied, but so had she.
Output (English): Past