Added restriction to crawling of sub-urls