Fixes deadlock when stopping the WEB crawler using the API