Overall cleanup
Added setNearDuplicateDetectionFactory to CrawljaxBuilder

- Removed deprecated setThreshold and setFeatures from the builder.
- Refactored duplicate-detection module to use user-defined factory if
set
- Fixed tests