Mirror localhost with wget, requires a robots.txt