Tests mail fail with an exception, we need to retry those too.

See [build 1687](https://scala-webapps.epfl.ch/jenkins/view/pr-validators/job/pr-scala-integrate-ide/1687/console) for an example of a flaky test failing the first try.