crawlers done and data gathered