Apparently rake task was doubling up execution of tests.