Issue 119: Fixed bug with maxpagestocrawl since we now check ShouldCrawlPage before scheduling, not after scheduling. No need to stop the crawl when maxpages has been reached anymore since the check is done on the main thread.