Remove renaming robots and add a robots disallow file.