DistCache namespacing and some test cleanup

8afb46d fixes the intermittent issues we were having with the tests blowing up when using DistCache
I don't think we should be doing this, we already have a random identifier for the job in the MrContext, is it feasible to use the same one. Then we don't have to rely on mutating the configuration.