Reconfigure robots.txt