Crawling mechanisn working. Multi-thread enabled by default.