Use reflection hacks to get JUnit test to run happily(-ish)

We don't seem to be getting any of the test output, but the
command it runs seems to work fine. So... progress!