Depending on url, get contents and crawl