Add new multi-thread crawler method