crawlers should go to production environment