Change the crawl notifications to notifications for all the domains and respect if for robots.txt as well.