Remove
Replace
Revert "Optimize #necessary threads spawned"

This reverts commit ff6d6ea61a2faf281eda371b3a9d61b73ab4afb6.

Conflicts:
	crawler/crawl.py