Change strategy: now using forkjoin pool of taks for crawlers.