Eventually the failures will have to be transferred to the Result. I don't see a way to do this outside of JUnitCore.