Crawler thread implementation, thread spawning