ZipNum: fixes: cached locations: don't throw RunTimeException if required (handled later), add a locCacheMaxDuration to cache only if below threshold
CDX: Add CloseableCompositeIterator which iterates in sequence, optimization for zipnum clusters to be loaded sequentially when only looking for last line
ZIP & SLR improvements: store connectedUrl immediately on connection, print connectedUrl on error, skip cached url on fallback to location list
ADD: CloseableIteratorWrapper utility class for wrapping regular iterators
FIX ZIPNUM: Flush cache, if any, when reloading locations
ZipNumBlock Loader: * add info on which shard failed to RuntimIOException
* use connectedUrl in all exceptions messages
* attemptBlockLoad: use SEVERE only on last retry of required cluster which will lead to a 503, use WARNING otherwise
ZIPNUMLoader: attempt better error msgs by propagating full error in exception
FIX: ApacheHttp31SLR save the connected url even on error!
ZIPNUM: track 2nd attempt to load correctly
FIX: ApacheSLR: turn off cookies when using manual cookie
HttpSLR: add optional error header which can be saved
RuntimeIOException: add status
MultiCDXInputSource: Make comparator public
FIX: MultiCDXInputSource: add optimization for output lazy initing of sequential cluster load
FEATURE: add getTotalCount() to cdx input sources
log RuntimeIOException
add ThreadLocalHttpConnectionManager (from heritrix-commons)
Switch to use ThreadLocalHttpConnectionManager as default for ApacheSLR!
fix path for ThreadLocalHttpConnectionManager
fix package
move ThreadLocalHttpConnectionManager to original package org.archive.httpclient
FEATURE: add support for httpcore 4.3 for SeekableLineReader!
apach43SLR: better reading of entire buffer
canonicalizer: add ExtractRule and RewriteRule