URLs are now marked as visited on start of crawling process