I tried to stick to the actual existing testing framework for the new Java API (JavaProgramTestBase, see eu.stratosphere.test.javaApiOperators).
When I change to DataSets I think I would have to write new logic for comparing the result instead of using the existing method for that.