Sends robots.txt file too.