crawler slow down due to very few retry candidates fixed