respond to robots.txt requests