Remove restart_threshold; restart crawl as soon as pending set is empty