Added /robots.txt as an endpoint.