allows crawler to crawl all the files under specified root by the first argument