Added much of recursive crawl