modified crawljob process