Module Import alias ImportFrom alias ImportFrom alias alias alias ImportFrom alias ImportFrom alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias ClassDef bases NameLoad body FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Lambda arguments args NameParam defaults Call NameLoad NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr If CompareEq Call AttributeLoad NameLoad attr Str Num body Assign AttributeStore NameLoad attr Call AttributeLoad Str attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num Str Assign AttributeStore NameLoad attr Call AttributeLoad Str attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num Str Assign AttributeStore NameLoad attr Call AttributeLoad Str attr SubscriptLoad NameLoad Index Num orelse Assign AttributeStore NameLoad attr Call AttributeLoad Str attr Str Assign AttributeStore NameLoad attr Call AttributeLoad Str attr Str Assign AttributeStore NameLoad attr Str Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad TryExcept body Assign TupleStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr Str ListLoad AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Str NameLoad NameLoad NameLoad Print NameLoad Assign NameStore Call NameLoad Lambda arguments args NameParam defaults CompareGt Call AttributeLoad NameLoad attr Str Num Call AttributeLoad NameLoad attr Assign NameStore SubscriptLoad Call AttributeLoad SubscriptLoad Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Index Num attr Str Index Num Print BinOpAdd Str NameLoad Assign AttributeStore NameLoad attr SubscriptLoad ListComp SubscriptLoad NameLoad Index Num comprehension NameStore Call AttributeLoad NameLoad attr NameLoad keyword AttributeLoad NameLoad attr CompareEq Call AttributeLoad SubscriptLoad NameLoad Index Num attr NameLoad Num Index Num Assign AttributeStore NameLoad attr NameLoad handlers ExceptHandler body Print Str Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr DictComp NameLoad Dict comprehension NameStore NameLoad Call NameLoad Call NameLoad AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad For NameStore Call AttributeLoad AttributeLoad NameLoad attr attr body Assign NameStore Call NameLoad AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad Call NameLoad NameLoad Str Assign NameStore Call NameLoad Call NameLoad NameLoad Str Assign NameStore ListComp NameLoad comprehension NameStore Call NameLoad Call NameLoad NameLoad Str CompareEq Call AttributeLoad NameLoad attr NameLoad Num Assign NameStore Call NameLoad Call NameLoad Call NameLoad NameLoad Str Assign NameStore Call NameLoad Call NameLoad NameLoad Str If CompareEq Call NameLoad NameLoad Num body Assign TupleStore NameStore NameStore NameStore NameStore TupleLoad NameLoad NameLoad NameLoad NameLoad TryExcept body Assign NameStore SubscriptLoad Call AttributeLoad SubscriptLoad Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Index Num attr Str Index Num Print NameLoad Assign TupleStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad ListLoad NameLoad handlers ExceptHandler body Print Call AttributeLoad Str attr SubscriptLoad NameLoad Index Num Print Str NameLoad orelse Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad Assign NameStore SubscriptLoad ListComp SubscriptLoad NameLoad Index Num comprehension NameStore Call AttributeLoad NameLoad attr NameLoad keyword AttributeLoad NameLoad attr CompareEq Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Num Index Num Print NameLoad Assign SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str NameLoad orelse Print Str Assign SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str Call NameLoad NameLoad If CompareEq Call NameLoad NameLoad Num body Assign SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str NameLoad Assign SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str Dict Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr ListLoad SubscriptLoad NameLoad Index Num For NameStore Call AttributeLoad Call AttributeLoad NameLoad attr Str Str attr Str body Assign SubscriptStore SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str Index NameLoad Call AttributeLoad NameLoad attr Str NameLoad If CompareNotEq Call NameLoad NameLoad Num body Print Call AttributeLoad Str attr NameLoad orelse If BoolOpAnd CompareEq Call NameLoad NameLoad Num CompareEq Call NameLoad NameLoad Num CompareEq Call NameLoad NameLoad Num body Print Call AttributeLoad Str attr NameLoad orelse If CompareEq Call AttributeLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad attr Str NameLoad body Print Call AttributeLoad Str attr NameLoad orelse Assign AttributeStore NameLoad attr NameLoad Assign SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str Dict Str Str Str Str Str Str Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad CompareEq Call NameLoad NameLoad Num AttributeLoad NameLoad attr Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Print Str For NameStore Call AttributeLoad AttributeLoad NameLoad attr attr body Print BinOpAdd NameLoad Call AttributeLoad Str attr SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str decorator_list FunctionDef arguments args NameParam NameParam defaults body Print Call AttributeLoad Str attr Call AttributeLoad NameLoad attr Print Call AttributeLoad Str attr SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str If SubscriptLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str Index Str body Print Call AttributeLoad Str attr NameLoad Assign NameStore Str For TupleStore NameStore NameStore Call NameLoad Call AttributeLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str attr body AugAssignAdd NameStore Call AttributeLoad Str attr NameLoad SubscriptLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index Str Index NameLoad If CompareEq BinOpAdd NameLoad BinOpMod Num Num Num body AugAssignAdd NameStore Str Print NameLoad Str decorator_list decorator_list ClassDef bases NameLoad body FunctionDef arguments args NameParam defaults body Pass decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore ListLoad Assign NameStore Call NameLoad NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr If CompareEq Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Num body TryExcept body Assign NameStore Call AttributeLoad Str attr Call AttributeLoad Call AttributeLoad Str attr Call AttributeLoad NameLoad attr attr Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler body Print Call AttributeLoad Str attr NameLoad orelse For TupleStore NameStore NameStore Call NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr If CompareEq Call AttributeLoad NameLoad attr Str BinOpSub Call NameLoad NameLoad Num body Assign NameStore SubscriptLoad NameLoad Slice Num Call AttributeLoad NameLoad attr Str TryExcept body Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler body Print Call AttributeLoad Str attr BinOpAdd NameLoad Num NameLoad Return NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults body Assign NameStore NameLoad TryExcept body Assign NameStore Call NameLoad NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad Str attr Call AttributeLoad NameLoad attr handlers ExceptHandler body Print Call AttributeLoad Str attr NameLoad Return NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults body Assign NameStore ListLoad Assign NameStore Call NameLoad NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr If CompareEq Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Num body TryExcept body Assign NameStore Call AttributeLoad Str attr Call AttributeLoad Call AttributeLoad Str attr Call AttributeLoad NameLoad attr attr Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler body Print Call AttributeLoad Str attr NameLoad orelse For TupleStore NameStore NameStore Call NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr If CompareEq Call AttributeLoad NameLoad attr Str BinOpSub Call NameLoad NameLoad Num body Assign NameStore SubscriptLoad NameLoad Slice Num Call AttributeLoad NameLoad attr Str TryExcept body Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler body Print Call AttributeLoad Str attr BinOpAdd NameLoad Num NameLoad Return NameLoad decorator_list NameLoad decorator_list
N/A N/A os os listdir os.path isfile join isdir glob glob collections defaultdict N/A sys N/A re N/A imp N/A string N/A inspect N/A json N/A new N/A ConfigParser N/A shutil Status N/A object N/A __init__ N/A N/A self N/A N/A N/A cur_dirs N/A filter N/A N/A N/A a N/A N/A isdir a N/A N/A os listdir N/A os curdir N/A N/A N/A N/A cur_dirs count data 0 N/A N/A N/A self data_dir N/A N/A {1}{0}{2}{0}{3} format N/A os sep N/A os curdir N/A cur_dirs N/A 0 data N/A N/A self to_upload_dir N/A N/A {1}{0}{2}{0}{3} format N/A os sep N/A os curdir N/A cur_dirs N/A 0 to_upload N/A N/A self project_dir N/A N/A {0} format N/A cur_dirs N/A 0 N/A N/A N/A self data_dir N/A N/A {0} format data N/A N/A self to_upload_dir N/A N/A {0} format to_upload N/A N/A self project_dir N/A N/A self management_ready False N/A N/A self crawl_ready False N/A N/A self item None N/A N/A N/A N/A f filename description N/A N/A imp find_module items N/A N/A self project_dir N/A module N/A N/A imp load_module items f filename description N/A module N/A x N/A filter N/A N/A N/A a N/A N/A N/A N/A a find scrapy.Item 0 N/A N/A f readlines N/A item_class_name N/A N/A N/A N/A N/A N/A N/A x N/A 0 split ( N/A 0 split N/A 1 N/A N/A Detected item class  item_class_name N/A N/A self item N/A N/A N/A item N/A 1 N/A item N/A N/A inspect getmembers module predicate N/A inspect isclass N/A N/A N/A N/A item N/A 0 find item_class_name 0 N/A 0 N/A N/A self crawl_ready True N/A N/A N/A N/A Unable to find item class N/A data_dirs N/A N/A os listdir N/A self data_dir N/A N/A self classifiers N/A d N/A N/A d data_dirs N/A isdir N/A join N/A self data_dir d N/A N/A self classify_ready False N/A classifier N/A N/A N/A self classifiers keys N/A N/A classifier_dir N/A join N/A self data_dir classifier N/A reviewed_files N/A glob N/A join classifier_dir [a-z]*[0-9]*.json N/A seed_files N/A glob N/A join classifier_dir [a-z]*_seed.json N/A unreviewed_files N/A f N/A f N/A glob N/A join classifier_dir [a-z]*.json N/A N/A N/A reviewed_files count f 0 N/A settings N/A glob N/A join N/A join classifier_dir settings.cfg N/A feature_extractor_files N/A glob N/A join classifier_dir *[Ff]eature*.py N/A N/A N/A len feature_extractor_files 1 N/A N/A N/A fe_name f filename description N/A None None None None N/A N/A N/A fe_name N/A N/A N/A N/A N/A N/A N/A feature_extractor_files N/A 0 split / N/A -1 split . N/A 0 N/A fe_name N/A N/A f filename description N/A N/A imp find_module fe_name N/A classifier_dir N/A N/A N/A N/A N/A N/A Error trying to read feature extractor file; make sure the feature class is the only class in the file {0} format N/A feature_extractor_files N/A 0 N/A Files : feature_extractor_files N/A N/A module N/A N/A imp load_module classifier f filename description N/A classifier_features N/A N/A N/A extractor N/A 1 N/A extractor N/A N/A inspect getmembers module predicate N/A inspect isclass N/A N/A N/A N/A extractor N/A 0 find FeatureExtractor -1 N/A 0 N/A classifier_features N/A N/A N/A N/A self classifiers N/A classifier N/A features classifier_features N/A N/A Only one feature extractor per classifier allowed N/A N/A N/A N/A self classifiers N/A classifier N/A seed N/A sorted seed_files N/A N/A N/A N/A self classifiers N/A classifier N/A reviewed N/A sorted reviewed_files N/A N/A N/A N/A self classifiers N/A classifier N/A unreviewed N/A sorted unreviewed_files N/A N/A N/A len settings 1 N/A N/A N/A N/A N/A self classifiers N/A classifier N/A settings settings N/A N/A N/A N/A self classifiers N/A classifier N/A classifications N/A N/A config N/A N/A ConfigParser RawConfigParser N/A N/A N/A config read N/A N/A settings N/A 0 N/A classification N/A N/A N/A N/A config get Classifier classes split , N/A N/A N/A N/A N/A N/A self classifiers N/A classifier N/A classifications N/A classification N/A N/A config get Classifier classification N/A N/A N/A len settings 1 N/A N/A N/A N/A Classifier in {0} has no clear settings format classifier N/A N/A N/A N/A N/A len reviewed_files 0 N/A N/A len unreviewed_files 0 N/A N/A len seed_files 0 N/A N/A N/A N/A Classifier in {0} has no data format classifier N/A N/A N/A N/A N/A N/A N/A self classifiers N/A classifier has_key features False N/A N/A N/A N/A Classifier in {0} does not have a clear features file format classifier N/A N/A N/A self classify_ready True N/A N/A N/A N/A self classifiers N/A classifier N/A info N/A seeds reviewed unreviewed settings features seed N/A len seed_files N/A len reviewed_files N/A len unreviewed_files N/A N/A len settings 1 N/A self classify_ready N/A len seed_files N/A program_status N/A N/A self N/A N/A N/A PROGRAM STATUS:
Current Classifiers 	 Seed 	 Reviewed 	 Unreviewed 	 Features
 N/A classifier N/A N/A N/A self classifiers keys N/A N/A N/A classifier N/A N/A 
			 {seed} 	 {reviewed} 		 {unreviewed} 		 {features}
 format N/A N/A N/A self classifiers N/A classifier N/A info N/A classifier_status N/A N/A self classifier_name N/A N/A N/A N/A N/A Classifier: {0} format N/A N/A classifier_name upper N/A N/A N/A                    	 Reviewed 	 Unreviewed 	 Features
			 {reviewed} 		 {unreviewed} 		 {features}
 format N/A N/A N/A self classifiers N/A classifier_name N/A info N/A N/A N/A N/A N/A self classifiers N/A classifier_name N/A info N/A settings N/A N/A N/A N/A Classifications :
	Name:Keep
 format classifier_name N/A classifications_string N/A N/A i classification N/A enumerate N/A N/A N/A N/A N/A self classifiers N/A classifier_name N/A classifications keys N/A N/A classifications_string N/A N/A {0}:{1}	 format classification N/A N/A N/A N/A self classifiers N/A classifier_name N/A classifications N/A classification N/A N/A N/A i N/A 1 4 0 N/A N/A classifications_string N/A classifications_string N/A N/A Reader N/A object N/A __init__ N/A N/A self N/A N/A N/A N/A read_seed N/A N/A cls file N/A N/A N/A data N/A N/A f N/A open file r N/A l N/A N/A f readlines N/A N/A N/A N/A N/A l N/A 0 find [ 0 N/A N/A N/A N/A json_string N/A N/A join N/A N/A N/A N/A join N/A N/A json_file readlines split N/A data N/A N/A json loads json_string N/A N/A N/A N/A N/A N/A Error reading {0} as seed JSON list format file N/A N/A N/A i line N/A enumerate l N/A N/A line N/A N/A line strip N/A N/A N/A N/A line rfind , N/A N/A len line 1 N/A N/A line N/A line N/A 0 N/A N/A line rfind , N/A N/A N/A datum N/A N/A json loads N/A N/A line strip N/A N/A N/A data append datum N/A N/A N/A N/A N/A N/A Error trying to read line {0} of {1} as seed JSON object format N/A i 1 file N/A data N/A classmethod read_reviewed N/A N/A cls file N/A N/A N/A datum None N/A N/A N/A json_file N/A open file r N/A datum N/A N/A json loads N/A N/A join N/A N/A json_file readlines N/A N/A N/A N/A N/A N/A Error reading {0} format file N/A datum N/A classmethod read_unreviewed N/A N/A clss file N/A N/A N/A data N/A N/A f N/A open file r N/A l N/A N/A f readlines N/A N/A N/A N/A N/A l N/A 0 find [ 0 N/A N/A N/A N/A json_string N/A N/A join N/A N/A N/A N/A join N/A N/A json_file readlines split N/A data N/A N/A json loads json_string N/A N/A N/A N/A N/A N/A Error reading {0} as unreviewed JSON list format file N/A N/A N/A i line N/A enumerate l N/A N/A line N/A N/A line strip N/A N/A N/A N/A line rfind , N/A N/A len line 1 N/A N/A line N/A line N/A 0 N/A N/A line rfind , N/A N/A N/A datum N/A N/A json loads N/A N/A line strip N/A N/A N/A data append datum N/A N/A N/A N/A N/A N/A Error trying to read line {0} of {1} as unreviewed JSON object format N/A i 1 file N/A data N/A classmethod N/A