Webcrawlers protection for staging instances.