Before revision:  We find that model architecture clearly influences syntactic generalization performance : Transformer models and models with explicit hierarchical structure reliably outperform pure sequence models in their predictions. In contrast , we find no clear influence of the scale of training data on these syntactic generalization tests.
After revision:  We find that model architecture clearly influences syntactic generalization performance by model architecture, with sequential models underperforming other architectures. Factorially manipulating model architecture and training dataset size (1M--40M words) , we find no clear influence of the scale of training data on these syntactic generalization tests.