Module Expr Str Import alias Import alias ImportFrom alias alias ImportFrom alias Assign NameStore Num ClassDef bases NameLoad body Assign NameStore Str Assign NameStore Str Assign NameStore Str Assign NameStore Str Assign NameStore Str Assign NameStore Str Assign NameStore Str Assign NameStore Str Assign NameStore Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list NameLoad FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Str Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad For TupleStore NameStore NameStore AttributeLoad NameLoad attr body If CompareNotIn NameLoad TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign TupleStore NameStore NameStore AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad If CompareIs NameLoad NameLoad body Assign NameStore Str Assign NameStore Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Slice NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Pass decorator_list FunctionDef arguments args NameParam defaults body Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Return Call NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpMod Str Call AttributeLoad NameLoad attr Return NameLoad decorator_list decorator_list Call AttributeLoad NameLoad attr keyword Str keyword Str keyword Str keyword Str keyword Str keyword Str keyword Str keyword Str keyword Str keyword Str keyword Str keyword Str FunctionDef arguments args NameParam defaults body Expr Str Return Call AttributeLoad NameLoad attr NameLoad keyword AttributeLoad NameLoad attr decorator_list Assign NameStore Call NameLoad Str Assign NameStore Call NameLoad Str Assign NameStore Call NameLoad Str Assign NameStore Call NameLoad Str Assign NameStore Call NameLoad BinOpMod Str AttributeLoad NameLoad attr Assign NameStore Call NameLoad BinOpMod Str AttributeLoad NameLoad attr Assign NameStore Call NameLoad TupleLoad Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr ClassDef bases NameLoad body Assign NameStore Call NameLoad TupleLoad Str Str Str FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr Num decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad body Expr Str Assign NameStore ListLoad Assign NameStore NameLoad If CompareIs NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr If CompareGt NameLoad Num body While NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad If BoolOpAnd NameLoad CompareGt NameLoad Num body If CompareIsNot NameLoad NameLoad body AugAssignAdd NameStore Call NameLoad NameLoad AugAssignSub NameStore Num If CompareNotEq Call AttributeLoad NameLoad attr Str Str body Expr Call AttributeLoad NameLoad attr TupleLoad Str Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr If CompareEq NameLoad Num body Break orelse Break If CompareGt NameLoad Num body AugAssignAdd NameStore TupleLoad Str NameLoad While NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad If NameLoad body Assign NameStore Call AttributeLoad NameLoad attr Str If CompareIsNot NameLoad NameLoad body AugAssignAdd NameStore Call NameLoad Call AttributeLoad NameLoad attr Str Break orelse If CompareIsNot NameLoad NameLoad body AugAssignAdd NameStore Call NameLoad NameLoad If UnaryOpNot Call AttributeLoad NameLoad attr NameLoad body Expr Call AttributeLoad NameLoad attr TupleLoad Str NameLoad If CompareGt Call NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr TupleLoad Str Return TupleLoad NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr If UnaryOpNot NameLoad body If NameLoad body Expr Call AttributeLoad NameLoad attr TupleLoad Str NameLoad Assign AttributeStore NameLoad attr Num Return TupleLoad NameLoad NameLoad NameLoad If NameLoad body Assign NameStore Num Assign NameStore NameLoad Assign NameStore Call NameLoad keyword NameLoad keyword NameLoad If CompareNotEq Call AttributeLoad NameLoad attr Str Str body Expr Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Str If CompareNotIn Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr BinOpMod Str Call AttributeLoad Str attr AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr Str If NameLoad body Expr Call AttributeLoad NameLoad attr Str NameLoad Assign NameStore Call AttributeLoad NameLoad attr While BoolOpAnd NameLoad UnaryOpNot Call AttributeLoad NameLoad attr NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad If NameLoad body If CompareNotEq Call AttributeLoad NameLoad attr Str Str body Expr Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr Str attr Assign NameStore ListLoad Call AttributeLoad Call AttributeLoad NameLoad attr Str attr Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad While NameLoad body If CompareNotEq Call AttributeLoad NameLoad attr Str Str body Expr Call AttributeLoad NameLoad attr Str NameLoad Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad Call AttributeLoad NameLoad attr Str attr Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad Str attr NameLoad If Call AttributeLoad NameLoad attr NameLoad body If NameLoad body Assign NameStore NameLoad orelse Expr Call AttributeLoad NameLoad attr Str NameLoad NameLoad orelse If Call AttributeLoad NameLoad attr NameLoad body TryExcept body Assign NameStore Call NameLoad NameLoad handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr Str NameLoad NameLoad orelse Expr Call AttributeLoad AttributeLoad NameLoad attr attr TupleLoad NameLoad NameLoad If CompareIsNot NameLoad NameLoad body If CompareGt NameLoad Num body Assign NameStore ListLoad Assign NameStore Num While CompareLt NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr If UnaryOpNot NameLoad body Break Expr Call AttributeLoad NameLoad attr NameLoad AugAssignAdd NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad Str attr NameLoad Assign TupleStore NameStore NameStore TupleLoad SubscriptLoad NameLoad Slice Num NameLoad SubscriptLoad NameLoad Slice NameLoad If CompareNotEq Call NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr Str Call NameLoad NameLoad NameLoad Assign AttributeStore NameLoad attr TupleLoad NameLoad NameLoad If Call AttributeLoad NameLoad attr NameLoad body Assign AttributeStore NameLoad attr Num orelse Assign AttributeStore NameLoad attr Num orelse Expr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Return TupleLoad NameLoad TupleLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Assign NameStore AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Assign NameStore ListLoad If NameLoad body Assign NameStore Call AttributeLoad NameLoad attr While NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad If NameLoad body If CompareNotEq Call AttributeLoad NameLoad attr Str Str body Expr Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Str AugAssignSub NameStore Num If CompareEq NameLoad Num body Break orelse Assign NameStore Num Expr Call AttributeLoad NameLoad attr TupleLoad Str NameLoad Assign NameStore Call AttributeLoad NameLoad attr If CompareGt NameLoad Num body Expr Call AttributeLoad NameLoad attr TupleLoad Str NameLoad Return NameLoad decorator_list decorator_list Assign NameStore Call NameLoad Str Expr Call NameLoad NameLoad NameLoad Expr Call NameLoad NameLoad NameLoad FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults body Assign NameStore ListLoad TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad TupleLoad AttributeLoad NameLoad attr NameLoad TupleLoad AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad keyword NameLoad keyword NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults body Assign NameStore ListLoad TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad TupleLoad AttributeLoad NameLoad attr NameLoad TupleLoad AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad keyword NameLoad keyword NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad body Assign NameStore ListLoad TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad TupleLoad AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad keyword NameLoad keyword NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad body Assign NameStore ListLoad TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad TupleLoad AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad keyword NameLoad keyword NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr If CompareIn Str NameLoad body Assign NameStore SubscriptLoad NameLoad Slice Call AttributeLoad NameLoad attr Str Return BinOpAdd NameLoad Str decorator_list
N/A N/A An object to represent warc records, using the abstract record in
record.py N/A re N/A hashlib hanzo.warctools.record ArchiveRecord ArchiveParser hanzo.warctools.archive_detect register_record_type N/A bad_lines 5 WarcRecord N/A ArchiveRecord N/A N/A VERSION WARC/1.0 N/A VERSION18 WARC/0.18 N/A VERSION17 WARC/0.17 N/A RESPONSE response N/A RESOURCE resource N/A REQUEST request N/A METADATA metadata N/A CONVERSION conversion N/A WARCINFO warcinfo __init__ N/A N/A self version headers content errors N/A VERSION None None None N/A N/A N/A N/A ArchiveRecord __init__ self headers content errors N/A N/A self version version N/A id N/A N/A self N/A N/A N/A N/A N/A self get_header N/A self ID N/A property _write_to N/A N/A self out nl N/A N/A N/A WARC Format:
            VERSION NL
            (Key: Value NL)*
            NL
            CONTENT NL
            NL

            don't write multi line headers
         N/A N/A N/A out write N/A self version N/A N/A N/A out write nl N/A N/A k v N/A self headers N/A N/A N/A k N/A N/A self CONTENT_TYPE N/A self CONTENT_LENGTH N/A self BLOCK_DIGEST N/A N/A N/A N/A out write k N/A N/A N/A out write :  N/A N/A N/A out write v N/A N/A N/A out write nl N/A N/A content_type content_buffer N/A self content N/A content_buffer N/A buffer content_buffer N/A content_type N/A N/A N/A N/A out write N/A self CONTENT_TYPE N/A N/A N/A out write :  N/A N/A N/A out write content_type N/A N/A N/A out write nl N/A N/A content_buffer None N/A N/A content_buffer N/A content_length N/A len content_buffer N/A N/A N/A out write N/A self CONTENT_LENGTH N/A N/A N/A out write :  N/A N/A N/A out write N/A str content_length N/A N/A N/A out write nl N/A block_digest N/A N/A self block_digest content_buffer N/A N/A N/A out write N/A self BLOCK_DIGEST N/A N/A N/A out write :  N/A N/A N/A out write block_digest N/A N/A N/A out write nl N/A N/A N/A out write nl N/A content_buffer N/A N/A N/A N/A out write N/A content_buffer N/A content_length N/A N/A N/A out write nl N/A N/A N/A out write nl N/A N/A N/A out flush N/A repair N/A N/A self N/A N/A N/A N/A validate N/A N/A self N/A N/A N/A N/A self errors N/A make_parser N/A N/A self N/A N/A N/A N/A WarcParser N/A classmethod block_digest N/A N/A self content_buffer N/A N/A N/A block_hash N/A N/A hashlib sha256 N/A N/A N/A block_hash update content_buffer N/A digest N/A sha256:%s N/A N/A block_hash hexdigest N/A digest N/A N/A N/A N/A ArchiveRecord HEADERS DATE WARC-Date TYPE WARC-Type ID WARC-Record-ID CONCURRENT_TO WARC-Concurrent-To REFERS_TO WARC-Refers-To CONTENT_LENGTH Content-Length CONTENT_TYPE Content-Type URL WARC-Target-URI BLOCK_DIGEST WARC-Block-Digest IP_ADDRESS WARC-IP-Address FILENAME WARC-Filename WARCINFO_ID WARC-Warcinfo-ID rx N/A N/A pat N/A N/A N/A Helper to compile regexps with IGNORECASE option set. N/A N/A N/A re compile pat flags N/A re IGNORECASE N/A N/A version_rx N/A rx ^(?P<prefix>.*?)(?P<version>\s*WARC/(?P<number>.*?))(?P<nl>
|
|
)\Z N/A header_rx N/A rx ^(?P<name>.*?):\s?(?P<value>.*?)(?P<nl>
|
|
)\Z N/A value_rx N/A rx ^\s+(?P<value>.+?)(?P<nl>
|
|
)\Z N/A nl_rx N/A rx ^(?P<nl>
|
|
\Z) N/A length_rx N/A rx N/A ^%s$ N/A WarcRecord CONTENT_LENGTH N/A type_rx N/A rx N/A ^%s$ N/A WarcRecord CONTENT_TYPE N/A required_headers N/A set N/A N/A N/A N/A WarcRecord TYPE lower N/A N/A N/A WarcRecord ID lower N/A N/A N/A WarcRecord CONTENT_LENGTH lower N/A N/A N/A WarcRecord DATE lower WarcParser N/A ArchiveParser N/A N/A KNOWN_VERSIONS N/A set N/A 1.0 0.17 0.18 __init__ N/A N/A self N/A N/A N/A N/A self trailing_newlines 0 N/A parse N/A N/A self stream offset line N/A None N/A N/A Reads a warc record from the stream, returns a tuple
        (record, errors).  Either records is null or errors is
        null. Any record-specific errors are contained in the record -
        errors is only used when *nothing* could be parsed N/A errors N/A N/A version None N/A N/A line None N/A N/A line N/A N/A stream readline N/A newlines N/A self trailing_newlines N/A N/A newlines 0 N/A N/A line N/A N/A match N/A N/A nl_rx match line N/A N/A match N/A newlines 0 N/A N/A N/A offset None N/A N/A offset N/A len line N/A newlines 1 N/A N/A N/A N/A match group nl N/A N/A N/A N/A errors append N/A incorrect trailing newline N/A N/A match group nl N/A line N/A N/A stream readline N/A N/A newlines 0 N/A N/A N/A N/A N/A N/A newlines 0 N/A N/A errors N/A less than two terminating newlines at end of previous record, missing newlines N/A line N/A N/A match N/A N/A version_rx match line N/A match N/A N/A version N/A N/A match group version N/A N/A offset None N/A N/A offset N/A len N/A N/A match group prefix N/A N/A N/A N/A offset None N/A N/A offset N/A len line N/A N/A N/A N/A nl_rx match line N/A N/A N/A N/A errors append N/A ignored line line N/A N/A N/A len errors bad_lines N/A N/A N/A N/A errors append N/A too many errors, giving up hope N/A N/A None errors offset N/A line N/A N/A stream readline N/A N/A line N/A N/A version N/A N/A N/A N/A errors append N/A warc version but no headers version N/A N/A self trailing_newlines 0 N/A N/A None errors offset N/A line N/A N/A content_length 0 N/A content_type None N/A record N/A WarcRecord errors errors version version N/A N/A N/A N/A match group nl N/A N/A N/A N/A record error incorrect newline in version N/A N/A match group nl N/A N/A N/A N/A match group number N/A self KNOWN_VERSIONS N/A N/A N/A N/A record error N/A version field is not known (%s) N/A N/A , join N/A self KNOWN_VERSIONS N/A N/A match group number N/A prefix N/A N/A match group prefix N/A prefix N/A N/A N/A N/A record error bad prefix on WARC version header prefix N/A line N/A N/A stream readline N/A N/A line N/A N/A N/A nl_rx match line N/A N/A match N/A N/A header_rx match line N/A match N/A N/A N/A N/A N/A match group nl N/A N/A N/A N/A record error incorrect newline in header N/A N/A match group nl N/A name N/A N/A N/A N/A match group name strip N/A value N/A N/A N/A N/A N/A match group value strip N/A line N/A N/A stream readline N/A match N/A N/A value_rx match line N/A match N/A N/A N/A N/A N/A match group nl N/A N/A N/A N/A record error incorrect newline in follow header line N/A N/A match group nl N/A N/A N/A value append N/A N/A N/A N/A match group value strip N/A line N/A N/A stream readline N/A match N/A N/A value_rx match line N/A value N/A N/A join value N/A N/A N/A type_rx match name N/A N/A value N/A N/A content_type value N/A N/A N/A N/A record error invalid header name value N/A N/A N/A N/A length_rx match name N/A N/A N/A N/A content_length N/A int value N/A N/A N/A ValueError N/A N/A N/A N/A record error invalid header name value N/A N/A N/A N/A N/A record headers append N/A name value N/A N/A content_length None N/A N/A N/A content_length 0 N/A N/A content N/A N/A length 0 N/A N/A length content_length N/A N/A line N/A N/A stream readline N/A N/A line N/A N/A N/A N/A N/A content append line N/A length N/A len line N/A content N/A N/A join content N/A N/A content line N/A N/A content N/A 0 content_length N/A content N/A content_length N/A N/A N/A len content content_length N/A N/A N/A N/A record error content length mismatch (is, claims) N/A len content content_length N/A N/A record content N/A content_type content N/A N/A N/A nl_rx match line N/A N/A N/A self trailing_newlines 1 N/A N/A N/A self trailing_newlines 2 N/A N/A N/A N/A record error missing header N/A WarcRecord CONTENT_LENGTH N/A N/A self trailing_newlines 2 N/A N/A record N/A offset N/A trim N/A N/A self stream N/A N/A N/A read the end of the file N/A newlines N/A self trailing_newlines N/A N/A self trailing_newlines 0 N/A errors N/A N/A newlines N/A N/A line N/A N/A stream readline N/A line N/A N/A match N/A N/A nl_rx match line N/A match N/A N/A N/A N/A N/A match group nl N/A N/A N/A N/A errors append incorrect trailing newline N/A N/A match group nl N/A newlines 1 N/A N/A newlines 0 N/A N/A N/A N/A newlines 0 N/A N/A N/A errors append N/A trailing data after content line N/A line N/A N/A stream readline N/A N/A newlines 0 N/A N/A N/A N/A errors append N/A less than two terminating newlines at end of record, missing newlines N/A errors N/A N/A N/A blank_rx N/A rx ^$ N/A N/A register_record_type version_rx WarcRecord N/A N/A register_record_type blank_rx WarcRecord make_response N/A N/A id date url content request_id N/A N/A N/A headers N/A N/A N/A WarcRecord TYPE N/A WarcRecord RESPONSE N/A N/A WarcRecord ID id N/A N/A WarcRecord DATE date N/A N/A WarcRecord URL url N/A request_id N/A N/A N/A N/A headers append N/A N/A WarcRecord CONCURRENT_TO request_id N/A record N/A WarcRecord headers headers content content N/A record N/A make_request N/A N/A request_id date url content response_id N/A N/A N/A headers N/A N/A N/A WarcRecord TYPE N/A WarcRecord REQUEST N/A N/A WarcRecord ID request_id N/A N/A WarcRecord DATE date N/A N/A WarcRecord URL url N/A response_id N/A N/A N/A N/A headers append N/A N/A WarcRecord CONCURRENT_TO response_id N/A record N/A WarcRecord headers headers content content N/A record N/A make_metadata N/A N/A meta_id date content concurrent_to url N/A None None N/A N/A headers N/A N/A N/A WarcRecord TYPE N/A WarcRecord METADATA N/A N/A WarcRecord ID meta_id N/A N/A WarcRecord DATE date N/A concurrent_to N/A N/A N/A N/A headers append N/A N/A WarcRecord CONCURRENT_TO concurrent_to N/A url N/A N/A N/A N/A headers append N/A N/A WarcRecord URL url N/A record N/A WarcRecord headers headers content content N/A record N/A make_conversion N/A N/A conv_id date content refers_to url N/A None None N/A N/A headers N/A N/A N/A WarcRecord TYPE N/A WarcRecord CONVERSION N/A N/A WarcRecord ID conv_id N/A N/A WarcRecord DATE date N/A refers_to N/A N/A N/A N/A headers append N/A N/A WarcRecord REFERS_TO refers_to N/A url N/A N/A N/A N/A headers append N/A N/A WarcRecord URL url N/A record N/A WarcRecord headers headers content content N/A record N/A warc_datetime_str N/A N/A d N/A N/A N/A s N/A N/A d isoformat N/A N/A . s N/A N/A s N/A s N/A N/A N/A s find . N/A N/A s Z N/A