It doesn't work if you just include the module in the current test class. I stole this idea from the Minitest test suite :)