Task: Linguistic Probing
Input (English): But they had their gods.
Output (English): Plural