Make sure only the production environment is indexed by crawlers.