Before revision:  Our results provide insights into how neural networks represent linguistic structure, and also about the kinds of structural biases that give learners the ability to model language.
After revision:  Our results provide insights into how neural networks represent linguistic structure, and also about the kind of structural inductive biases which a learner needs to model language.