Before revision:  We find transformers appear to learn rule-based reasoning with high (99\%) accuracy on these datasets, and in a way that generalizes to test data requiring substantially deeper chaining than in the training data (95\%+ scores).
After revision:  We find transformers appear to learn rule-based reasoning with high (99\%) accuracy , and generalizes to test data requiring substantially deeper chaining than in the training data (95\%+ scores).