starting to mess with httpcomponents
continuing to mess with httpcomponents
FetchHTTP2, based on httpcomponents, is working in a rudimentary way. This commit also gets rid of most egregious commons-httpclient-specific code in CrawlURI
FetchHTTP2 - record, archive request as well
continuing to mess with httpcomponents
continuing to mess with httpcomponents
different deeper way to insert our Recorder, letting us correctly note end of http headers. is there a problem with not buffering at this level?
license headers
not using HcInputWrapper anymore
do recording through SessionOutputBuffer implementation like we have for SessionInputBuffer; refactor helper classes into their own file RecordingHttpClient.java
move httpclient helper classes to commons/
set user-agent
no keep-alive
browser-compatibility mode for cookie matching; that's what old FetchHTTP does, and also avoids sending weird Cookie2:$Version1
get charset, encodings from headers
use http 1.0 by default, other request configuration stuff
resolve hostnames from heritrix server cache (the bad old way)
do not rely on ToeThread for the ServerCache, pass it to where it's needed instead
bdb cookie store for FetchHTTP2
Merge branch 'master' into fetchhttp-hc