add support for manually stop crawler