Before revision:  These findings are significant as it suggests a new role for transformers, namely as a limited "soft theorem prover " operating over explicit theories in language.
After revision:  These findings are significant as it suggests a new role for transformers, namely as a limited "soft theorem provers " operating over explicit theories in language.