Fix NUTCH-1640

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1534962 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1666 Optimisation for BasicURLNormalizer (jnioche)

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1540654 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1100 avoid NPE in SOLRDedup

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1540758 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-656 Generic Deduplicator (jnioche, snagel)

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1541883 13f79535-47bb-0310-9956-ffa450edef68
Removed all in one Crawl class (NUTCH-1621)

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1541885 13f79535-47bb-0310-9956-ffa450edef68
Giving Cleaning and Deduplication jobs a name to display

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1541917 13f79535-47bb-0310-9956-ffa450edef68
Merged changes from Apache repo - Deduplication