DEVELOPER-828 enable robots.txt for prod