Create robots.txt

Add a robots.txt file for crawlers