split crawl function