Added robots.txt test for domain.Domain