catch added to main crawler func