Added robotexclusionrulesparser as a requirement