Task: Linguistic Probing
Input (English): I didn't think they would be, considering almost nobody working in the office knew of door that.
Output (English): Inversion