Adds a stemmer to the index.
Created a method in Program for writing a single colored line to the console.
Updated Index such that it automatically keeps track of URLs and their index.
Moved the frontier and exclusions conditions into the filter method - filtering is performed completely within this method.
Program writes a green line when two documents are similar.
Console width expanded.
Updated the version of the DeadDog submodule.
Created a document class.
Updated the version of the DeadDog submodule.
All the crazy stuff we did, making the crawler freaking awesome!
Revert "tilføjet en indkapslet type der indeholder URL'erne"

This reverts commit 67442c8c63a231ec3fbfcb92e10cb236de6b8c15.
Merge branch 'mikkel-index'
Created a bunch of classes for maintaining filtering.
If no html can be retrived for document it is considered empty.
Fixed bug; EntentionFilter compared '.ext' to 'ext' - the period has been removed.
The frontier reuses Document instances when re-loading pages - identification is done based on thir URL.
Changed the order of filters, such that domain and extension is tested before frontier and exclusion.
Added additional console output in Main.
Implemented persistency in the Exclusions class.
Updated the version of the DeadDog submodule.