Added testHasRobotsTxtNoSitemapGetsNoRssNoAtomGetsNoUrls