Enabled Nuget package restore. Added OverriddenCrawlConfiguration.cs to be more clear on how the web crawler crawls.
Merge branch 'master' of https://github.com/thealah/CrawlTester