Create buzzy cache directory

We need this so that it's guaranteed to have the right permissions, even
when we override one of its subdirectories via mounted Docker volumes.
(When you do that, Docker creates any missing intermediate directories
as `root:root`.)