Cleanup the moved advancedsetting.xml file