Adds robot whitelisting