etorreborre/specs2 — Issue #62: Inconsistent Test Counts
Author: alltonp
Created: 2012-02-17 13:10:23+00:00
State: open

Hi,

I've noticed a few times on our build box that the test count seems to fluctuate a bit, even when the number of tests stays constant. I initially thought this might be a problem with teamcity, parsing the junitxml reports, but now I've just whitnessed it on the command line.

For three runs of the same test suite, I've just seen:

```
[error] Failed: : Total 180, Failed 1, Errors 0, Passed 179, Skipped 0
..
[error] Failed: : Total 178, Failed 1, Errors 0, Passed 177, Skipped 0
..
[error] Failed: : Total 180, Failed 1, Errors 0, Passed 179, Skipped 0
```

Interestingly, on our build box, the command line reported that were 180 tests, but team city (which is parsing the junixml reports) thinks there are 174.