update develop to 0.4.6
improved regex for top -> WB_wombat_top rewriting
framed replay: improved url update support, ensure update url is actually
the url of the frame (ignore ajax requests)
rewrite: for WB_wombat_top rewriting, select next-to-top instead of self
rules: additions to rules for FB
archive indexing: Refactor, split into ArchiveIterator generic iteration and cdx-indexer,
which writes out CDX specifically
recordloader: always load request, limit stream before headers are loaded
cdx indexing: add support for 9-field cdx output,
request merge: store referer if available, check for record id matching
indexing: refactor cdxindexer interface to better allow custom writers
record loader: skip whois: and dns: records, better skipping of arc headers
(todo: need more unit tests)
warc: simplify recordloader a bit more, only response and request records
get parsed as http (excluding dns: and whois: uris)
All others have an '-' status and no headers parsing
tests: add test for zero-length revisits
tests: add 'bad.cdx' for testing cdx lines with missing original for revisit,
missing/non-existant warc
disable decoding, by default, of content for html parser
pass raw bytes to htmlparser, assuming ascii-compatibility
(todo: add tests for non-ascii compatible encodings)
improved rendering of certain pages, needs more testing

lxml: remove lxml and complexity associated with having the parser,
as its too unpredictable for older html, does its own decoding.
indexing: don't include records of type 'application/warc-fields' unless all records are being included
Merge branch 'develop' into binary-parse
regexrewrite: fix rewrite for 'top'
tests: add test for wombat top
Merge branch 'develop' into binary-parse
warc indexing: in include_all mode, pass 'warcinfo' records to writer, allowing it to option to handle or ignore
Merge branch 'develop' into binary-parse
fix 'bad.cdx' sorting order
update changelist, version to 0.4.7