Using `rails runner` won't exhibit the problem, because that goes through `Spring::Client::Rails`, and the bug is in `Spring::Client::Run`.

Looks like I can avoid the custom rake task though using `rake -p`, and I'll use `assert_success` like you suggest.