Working on parallel crawler solution, not much progress yet