web-commons: add a "best pick" timestamp iterator which can pick either curr or next capture when there is a dupe
(may be combined with base timestamp dedup iterator)
ia-web-commons: using overlays httpclient, necessary for loading malformed arc files without errors
pom: switching back to standard httpclient 3.1 instead of archive-overlay
pom: using standard httpclient 3.1 again
actually add httpclient 3.1 depend to pom.xml (again)
consolidate disparate versions of WARCConstants into one version that lives in ia-web-commons
SortedTextFile and ZipNumCluster: getRange() method for getting first and last line
of (no splits), fixes for line calculation and splitting for
no end boundary condition (use getLastLine() to get the last line)
ArchiveUtils: getDate(String, Date default) function added
make HDFSDefaultUri static
don't check for start or end if they are null/empty
ZipNumCluster: don't add .gz to cluster part if already has .gz
LocationUpdater: Auto-disable the cluster if failure to load location file
LocationUpdater: Support for ALL.lastblocks file added, reloaded same time as ALL.loc, part of ZipNumCluster interface
fixed getLastLine() to keep going back if initial line length guess is to short
ZipNumBlockLoader / HttlSLR: Add support for Cookie to be passed in as part of request
Added a suitable travis-ci config file.
make doubleToString(double,int,int) public for archive-it
formatBytesForDisplay() - don't include decimal part for e.g. 3 B (was saying 3.0 B), add tests
zipnum: support for getting the location root path
Merge branch 'master' of github.com:internetarchive/ia-web-commons
CDXFile: don't include prev line in plain cdx bin search
WaybackURLKeyMaker: add ability to specify custom rewrite rules with startswith, regex and replace