try to fix crawls stopping too early