allow robots.txt
Merge pull request #41 from springfiles/master

allow robots.txt