Initial instrumentation of 'crawl' CLI subcommand
Added multithreading support