Before revision:  These results suggest that current RNNs do not capture the underlying hierarchical rules of natural language , but rather use shallower heuristics for their predictions .
After revision:  These results suggest that current RNNs do not capture the underlying syntax of agreement , but rather use shallower heuristics for their predictions .