Exit status should always be 0 if $? is nil
Don't try to test with unsupported Runners
Hack for getting modified envs to work in jruby