Fix robots.txt

i am running this patch now on my server and it seems like it works properly whether a static robots.txt file exists or not.

See #340