Question: Do the authors have a hypothesis as to why morphological agreement is hardly learned by any model?
Answer: These models are likely to be deficient in encoding morphological features is that they are word level models, and do not have direct access sub-word information like inflectional endings, which indicates that these features are difficult to learn effectively purely from lexical distributions.