Tests for Broder's near duplicate detection
Implementation of Broder's ndd
Compatibility fixes for crawlhash and broder ndd
Fix tests
Improvements made to FeatureShingles.
Refactoring/improvements made to Singleton, Exception, featureSizeType
Implementation of the abstract HashGenerators
Refactore existing code to use new hashGenerators
Added comments for new classes
Added tests for HashGenerators
Add tests for to big feature sizes
Fix tests
Merge branch 'Broders-duplicate-detection' of https://github.com/erwinvaneyk/crawljax into Broders-duplicate-detection

Conflicts:

core/src/test/java/com/crawljax/core/duplicatedetection/CrawlHashTest.ja
va

core/src/test/java/com/crawljax/core/duplicatedetection/FeatureShingleTe
st.java
Seperate new implementation in StateVertex from old
Merge branch 'Broders-duplicate-detection' of https://github.com/erwinvaneyk/crawljax into Broders-duplicate-detection

Conflicts:
	core/src/main/java/com/crawljax/core/state/StateVertexImpl.java
Conflict cleanup
Revert putIfAbsent to orginal code
Fix tests
Merge conflict
Fix (again)