Module Expr Str Import alias Import alias Import alias ImportFrom alias Assign NameStore Call AttributeLoad NameLoad attr BinOpMod Str Call AttributeLoad Str attr GeneratorExp Call AttributeLoad NameLoad attr Call NameLoad NameLoad comprehension NameStore BinOpAdd BinOpAdd Call NameLoad Num Num Call NameLoad Num Num Call NameLoad Num Num Assign NameStore Call AttributeLoad NameLoad attr Str ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad kwarg body If UnaryOpNot Call AttributeLoad SubscriptLoad NameLoad Index Str attr Str body Return If CompareIn AttributeLoad NameLoad attr TupleLoad Num Num body Return orelse If CompareLtELt Num AttributeLoad NameLoad attr Num body Expr Call AttributeLoad NameLoad attr Str NameLoad AttributeLoad NameLoad attr orelse If CompareNotEq AttributeLoad NameLoad attr Num body Expr Call AttributeLoad NameLoad attr Str NameLoad AttributeLoad NameLoad attr If CompareEq SubscriptLoad NameLoad Index Str Str body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str orelse Assign NameStore AttributeLoad NameLoad attr If UnaryOpNot NameLoad body Expr Call AttributeLoad NameLoad attr Str NameLoad Return Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Str NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr Str NameLoad NameLoad Call NameLoad GeneratorExp Call NameLoad Call NameLoad NameLoad comprehension NameStore Call AttributeLoad NameLoad attr NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Dict Str Str Str Str Str Str Str Str Str NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad Assign NameStore Call NameLoad NameLoad GeneratorExp Call AttributeLoad NameLoad attr comprehension NameStore Call AttributeLoad NameLoad attr Str Assign NameStore ListLoad Assign NameStore ListLoad For NameStore NameLoad body If CompareIn Str NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad orelse Expr Call AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr Str NameLoad Call AttributeLoad Str attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr Str NameLoad Call AttributeLoad Str attr NameLoad decorator_list decorator_list Assign NameStore NameLoad
N/A N/A 
HTML validation plugin which uses Jason Stitt's pytidylib wrapper for HTML Tidy

Prerequisites:
    tidylib: http://tidy.sourceforge.net/
    pytidylib: http://countergram.com/software/pytidylib/
 N/A logging N/A re N/A tidylib base Plugin N/A CONTROL_CHAR_RE N/A N/A re compile N/A [%s] N/A N/A join N/A N/A N/A re escape N/A unichr c N/A c N/A N/A N/A range 0 8 N/A range 14 31 N/A range 127 160 N/A LOG N/A N/A logging getLogger crawler Tidy N/A Plugin N/A N/A Make sure your response is good post_request N/A N/A self sender response url N/A None kwargs N/A N/A N/A N/A N/A N/A response N/A Content-Type startswith text/html N/A N/A N/A N/A N/A response status_code N/A 301 302 N/A N/A N/A N/A N/A 400 N/A response status_code 600 N/A N/A N/A N/A LOG warning %s: Validating HTTP %d error page url N/A response status_code N/A N/A N/A N/A response status_code 200 N/A N/A N/A N/A LOG warning %s: Validating unusual HTTP %d response url N/A response status_code N/A N/A N/A response N/A Content-Type text/html; charset=utf-8 N/A N/A html N/A N/A N/A response content decode utf-8 N/A N/A html N/A response content N/A N/A html N/A N/A N/A N/A LOG error %s: not processing empty response url N/A N/A N/A html sub_count N/A N/A CONTROL_CHAR_RE subn html N/A sub_count N/A N/A N/A N/A LOG warning %s: Stripped %d control characters from body: %s url sub_count N/A set N/A N/A hex N/A ord i N/A i N/A N/A CONTROL_CHAR_RE findall html N/A N/A tidied_html messages N/A N/A tidylib tidy_document N/A N/A html strip N/A char-encoding clean drop-empty-paras drop-font-tags drop-proprietary-attributes fix-backslash indent output-xhtml utf8 False False False False False False False N/A messages N/A filter None N/A N/A N/A l strip N/A l N/A N/A messages split N/A errors N/A N/A warnings N/A N/A msg messages N/A N/A N/A Error: msg N/A N/A N/A N/A errors append msg N/A N/A N/A N/A warnings append msg N/A errors N/A N/A N/A N/A LOG error %s: HTML validation errors:
	%s url N/A N/A join errors N/A warnings N/A N/A N/A N/A LOG warning %s: HTML validation warnings:
	%s url N/A N/A join warnings N/A N/A N/A PLUGIN Tidy