Before revision:  We find that model architecture clearly influences syntactic generalization performance : Transformer models and models with explicit hierarchical structure reliably outperform pure sequence models in their predictions.
After revision:  We find substantial differences in syntactic generalization performance : Transformer models and models with explicit hierarchical structure reliably outperform pure sequence models in their predictions.