Added logic to crawl only updated list