Improve testing around XYZAllObjects and other stuff

This PR fixes all kinds of stuff related to the test suite, removing a lot of the unpredictability as well as adding more tests around the "AllObjects" family of methods.