Please change this to rspec or cucumber so that it is always run in travis-ci and it follows our test conventions.  You should be able to capture stderr and stdout using popen3 in rspec.