https://github.com/scrapy/dirbot