Added robots.txt.
Added test for it too.