add urlList and crawl related functionalities