add the robots file.