adding cname and robots