robot.txt and sitexmlpath.xml file is created and updated