WIP: Allow setting up files for testing cached data.

Wait - do you still want a PR - it looks like this is moving to devteam?