added a robots.txt to each subdomain