follow redirects for robots!