crawler scans log for requeueing