Before revision:  However, they suffer from over-parameterization.
After revision:  Training very large transformer models allowed significant improvement in both fields, but once trained, these networks show symptoms of over-parameterization.