NUTCH-1419 parsechecker and indexchecker to report protocol status

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1461276 13f79535-47bb-0310-9956-ffa450edef68
parsechecker and indexchecker to report truncated content

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1461854 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1547 BasicIndexingFilter - Problem to index full title 

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1462078 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1031 Delegate parsing of robots.txt to crawler-commons

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1465159 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1554 org.apache.nutch.net.protocols.HttpDateFormat should NOT be Locale.US aware

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1465741 13f79535-47bb-0310-9956-ffa450edef68
revert NUTCH-1554 org.apache.nutch.net.protocols.HttpDateFormat should NOT be Locale.US aware

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1465831 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1501 Harmonize behavior of parsechecker and indexchecker

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1469100 13f79535-47bb-0310-9956-ffa450edef68
Fixed detection of job file for distributed mode

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1469231 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-829 duplicate hadoop temp files

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1476702 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-346 Improve readability of logs/hadoop.log

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1476859 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1549 Fix deprecated use of Tika MimeType API in o.a.n.util.MimeUtil

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1477821 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1334 NPE in FetcherOutputFormat

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1477847 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1514 Phase out the deprecated configuration properties (if possible)

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1478939 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1277 Fix [fallthrough] javac warnings

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1479775 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-956 solrindex issues

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1480485 13f79535-47bb-0310-9956-ffa450edef68
Added crawler-commons dependency in pom.xml

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1480551 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1053 Parsing of RSS feeds fails

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1484628 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1249 and NUTCH-1275 : Resolve all issues flagged up by adding javac -Xlint argument

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1484634 13f79535-47bb-0310-9956-ffa450edef68
NUTCH-1513 Support Robots.txt for Ftp urls

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1484638 13f79535-47bb-0310-9956-ffa450edef68
removed unnecessary import, accidentally committed with r1484634

git-svn-id: https://svn.apache.org/repos/asf/nutch/trunk@1484822 13f79535-47bb-0310-9956-ffa450edef68