notes in README.md regarding my fork
using a bloom filter to track already crawled urls