Adds preventCrawler (robots.txt) toggle.