correct set() error in crawl.py; add tests