Adding a test to check for robots.txt
Merge pull request #37 from brandonsavage/robotsbranch

Adding a test for robots.txt to verify that it exists.