Modified crawling behaviour in three steps
+ Match: Receives an URL and returns a worker class with all the parameters needed to download and crawl
+ Download: Downloads the URL
+ Crawl: Crawls the data

Now download and crawl actions are done in a separate class called datCrawlWorker. Now you can only receive the worker, doing the download and crawl actions independently. For advanced crawling.