Task: Question Generation
Input (English): So, we can impose the constraint that our model's representation of the input's syntax cannot contain this context-invariant information. This regularization is strictly preferable to allowing all aspects of word meaning to propagate into the input's syntax representation. Without such a constraint, all inputs could, in principle, be given their own syntactic categories.
Output (English): Does having constrained neural units imply word meanings are fixed across different context?