Yes, indeed. That's why I changed this. The first builds for #494 passed but didn't succeed (couldn't build test framework => no tests to run => tests "succeed"). So this isn't an optimization but required for correctness.