REFACTOR: Separate LiveWebRedirector into base LiveWebRedirector and DefaultLiveWebRedirector for better abstraction
FIX: check ignore robots for urlkey
FIX: PARSING: add missing </head> when <body> tag is found first (for ARI-3561)
FIX: Fix url-agnostic dedup not working with EmbeddedCDXServer
DEBUG: add better logging to unexpected EmbeddedCDXServer errors
REWRITING FIX: Support https only rewriting where only https->http urls are rewritten.
Urls that don't have a scheme are skipped
FIX: remove content-encoding from the *headers* resource, but decode the *payload* resource, ensure the fix happens before headers are copied!
FIX: Fix unit test, need to add Content-Encoding: gzip to revisit header resource test, as the payload is also gzip encoded
FEATURE: Add JWAT wayback library dependency and JWATFlexResourceStore which uses JWATResource
FEATURE: Move JWATResource into wayback-core, depending directly on jwat 1.0 release now
remove dependency on heritrix-commons
follow-up fix for 7b2597eec4: fix missing CRLF, add gzipContent flag to
test case factory methods.