Tests mail fail with an exception, we need to retry those too.
Merge pull request #517 from dragos/issue/flaky-test-errors

Tests may fail with an exception, we need to retry those too.