renamed build-sitemap to crawl
remove unused leaf? function
unused recommender engine detection module
removed rich char extractor
replaced build-sitemap instances with crawl
moved sampling codebase to extractor
after the mild refactor the structure driven crawler is performing