prevent division by zero
if we have many hosts, use on-demand earlier
better delete all files in path when removing host crawl stack