Set the modules cache to be inside the test-build folder, so that we don't share it with anything else.
We *do* preserve it across builds though, as that ought to be safe.