add robotexclusionrulesparser modify setting for test