* make crawlers shutdown after 5 seconds of no input
* create pool of crawlers dynamically