Add resuming feature for threaded crawling
Add resuming feature for threaded crawling