Update importer to handle inheritance on robot.xml