refactoring crawl info