Creates initial scope of files and directories/folders of a web site for Spiders/Robots/Crawlers