Better trash cleanup.
Generate static sites/foo.com/files/robots.txt file per site, which is mapped to /robots.txt