Module ImportFrom alias Import alias Import alias ImportFrom alias ImportFrom alias ClassDef bases NameLoad body FunctionDef arguments args NameParam NameParam defaults body Return Call NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults body Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Pass decorator_list FunctionDef arguments args NameParam NameParam defaults body Pass decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Pass decorator_list decorator_list ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam defaults NameLoad NameLoad body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad If NameLoad body Assign AttributeStore NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Str Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr GeneratorExp Call AttributeLoad NameLoad attr comprehension NameStore AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Str Return Call NameLoad Call NameLoad NameLoad NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr NameLoad If CompareIn NameLoad AttributeLoad NameLoad attr body Return NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpAdd NameLoad AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Return Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body If AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body If AttributeLoad NameLoad attr body Assign NameStore Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Dict Str NameLoad keyword Dict Str NameLoad orelse If AttributeLoad NameLoad attr body Assign NameStore Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Dict Str NameLoad keyword Dict Str NameLoad Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Str keyword NameLoad decorator_list decorator_list
N/A __future__ print_function N/A os N/A logging scrapy.utils.job job_dir scrapy.utils.request request_fingerprint BaseDupeFilter N/A object N/A from_settings N/A N/A cls settings N/A N/A N/A N/A cls N/A classmethod request_seen N/A N/A self request N/A N/A N/A False N/A open N/A N/A self N/A N/A N/A N/A close N/A N/A self reason N/A N/A N/A N/A log N/A N/A self request spider N/A N/A N/A N/A N/A RFPDupeFilter N/A BaseDupeFilter N/A N/A Request Fingerprint duplicates filter __init__ N/A N/A self path debug N/A None False N/A N/A N/A self file None N/A N/A self fingerprints N/A set N/A N/A self logdupes True N/A N/A self debug debug N/A N/A self logger N/A N/A logging getLogger __name__ N/A path N/A N/A N/A self file N/A open N/A N/A N/A os path join path requests.seen a+ N/A N/A N/A N/A self file seek 0 N/A N/A N/A N/A self fingerprints update N/A N/A N/A x rstrip N/A x N/A self file N/A from_settings N/A N/A cls settings N/A N/A N/A debug N/A N/A settings getbool DUPEFILTER_DEBUG N/A N/A cls N/A job_dir settings debug N/A classmethod request_seen N/A N/A self request N/A N/A N/A fp N/A N/A self request_fingerprint request N/A N/A fp N/A self fingerprints N/A N/A True N/A N/A N/A N/A self fingerprints add fp N/A N/A self file N/A N/A N/A N/A N/A self file write N/A fp N/A os linesep N/A request_fingerprint N/A N/A self request N/A N/A N/A N/A request_fingerprint request N/A close N/A N/A self reason N/A N/A N/A N/A self file N/A N/A N/A N/A N/A self file close N/A log N/A N/A self request spider N/A N/A N/A N/A self debug N/A N/A msg Filtered duplicate request: %(request)s N/A N/A N/A N/A self logger debug msg N/A request request extra N/A spider spider N/A N/A N/A self logdupes N/A N/A msg Filtered duplicate request: %(request)s - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates) N/A N/A N/A N/A self logger debug msg N/A request request extra N/A spider spider N/A N/A self logdupes False N/A N/A N/A N/A N/A spider crawler stats inc_value dupefilter/filtered spider spider N/A N/A