added logic for crawling local filesystem