robots settings are now configurable by config.flexcontent.json