batch crawl job was not properly saving to local redis