Module ImportFrom alias ImportFrom alias Import alias alias alias ImportFrom alias ImportFrom alias ImportFrom alias alias ImportFrom alias alias alias Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad ClassDef bases NameLoad body FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad Call NameLoad NameLoad NameLoad attr Assign AttributeStore NameLoad attr Call NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr Str Assign AttributeStore AttributeLoad NameLoad attr attr Str Assign AttributeStore AttributeLoad NameLoad attr attr Str Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call NameLoad Expr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call NameLoad keyword Str keyword AttributeLoad NameLoad attr keyword Str keyword Str keyword NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr Call NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr Str Assign AttributeStore AttributeLoad NameLoad attr attr Str Assign AttributeStore AttributeLoad NameLoad attr attr Str Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore AttributeLoad NameLoad attr attr Str Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore AttributeLoad AttributeLoad NameLoad attr attr attr Num Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Assign NameStore Dict Str Str Str Num Str Str Assign NameStore Call NameLoad NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore AttributeLoad NameLoad attr attr Str Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore ListLoad Assign NameStore Call AttributeLoad Str attr keyword Call NameLoad Call AttributeLoad NameLoad attr Num Num Assign AttributeStore AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr For NameStore NameLoad body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr NameLoad NameLoad If UnaryOpNot Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad body Expr Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If UnaryOpNot Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad body Assign NameStore Call NameLoad NameLoad Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore ListLoad Str Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore ListLoad Str Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore ListLoad Str Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore ListLoad Str Str Str Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore ListLoad Str Str Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Num decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr NameLoad Call AttributeLoad NameLoad attr Num decorator_list Call AttributeLoad NameLoad attr Str decorator_list
N/A __future__ unicode_literals builtins str N/A os.path random unittest scrapy.exceptions CloseSpider scraper.models Event scraper.scraper_test EventChecker ScraperTest dynamic_scraper.models Checker Log SchedulerRuntime N/A PROJECT_ROOT N/A N/A N/A os path abspath N/A N/A N/A os path dirname __file__ CheckerRunTest N/A ScraperTest N/A setUp N/A N/A self N/A N/A N/A N/A N/A N/A super CheckerRunTest self setUp N/A N/A self checker N/A Checker N/A N/A N/A self checker scraped_obj_attr N/A self soa_url N/A N/A N/A self checker scraper N/A self scraper N/A N/A N/A self checker checker_type X N/A N/A N/A self checker checker_x_path //div[@class="event_not_found"]/div/text() N/A N/A N/A self checker checker_x_path_result Event was deleted! N/A N/A N/A self checker checker_ref_url http://localhost:8010/static/site_for_checker/event_not_found.html N/A N/A N/A N/A self checker save N/A scheduler_rt N/A SchedulerRuntime N/A N/A N/A scheduler_rt save N/A N/A self event N/A Event title Event 1 event_website N/A self event_website description Event 1 description url http://localhost:8010/static/site_for_checker/event1.html checker_runtime scheduler_rt N/A N/A N/A N/A self event save N/A setUpWithSecondChecker N/A N/A self N/A N/A N/A N/A self checker2 N/A Checker N/A N/A N/A self checker2 scraped_obj_attr N/A self soa_url N/A N/A N/A self checker2 scraper N/A self scraper N/A N/A N/A self checker2 checker_type X N/A N/A N/A self checker2 checker_x_path //div[@class="event_not_found"]/div/text() N/A N/A N/A self checker2 checker_x_path_result Event was deleted! N/A N/A N/A self checker2 checker_ref_url http://localhost:8010/static/site_for_checker/event_not_found.html N/A N/A N/A N/A self checker2 save N/A test_no_checker N/A N/A self N/A N/A N/A N/A N/A N/A self checker delete N/A N/A N/A self assertRaises CloseSpider N/A self run_event_checker 1 N/A test_x_path_type_keep N/A N/A self N/A N/A N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event1.html N/A N/A N/A N/A self event save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 1 N/A test_x_path_type_keep_double N/A N/A self N/A N/A N/A N/A N/A self setUpWithSecondChecker N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event1.html N/A N/A N/A N/A self event save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 1 N/A test_x_path_type_blank_result_field_keep N/A N/A self N/A N/A N/A N/A N/A self scraper checker_x_path_result N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event1.html N/A N/A N/A N/A self event save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 1 N/A test_x_path_type_404_delete N/A N/A self N/A N/A N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event_which_is_not_there.html N/A N/A N/A N/A self event save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 0 N/A test_x_path_type_404_delete_with_zero_actions N/A N/A self N/A N/A N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event_which_is_not_there.html N/A N/A N/A N/A self event save N/A N/A N/A N/A self event checker_runtime num_zero_actions 3 N/A N/A N/A N/A N/A self event checker_runtime save N/A kwargs N/A id do_action run_type 1 yes TASK N/A checker N/A EventChecker kwargs N/A N/A N/A N/A self process crawl checker kwargs N/A N/A N/A N/A self process start N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 1 N/A test_x_path_type_x_path_delete N/A N/A self N/A N/A N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event2.html N/A N/A N/A N/A self event save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 0 N/A test_x_path_type_x_path_first_delete_double N/A N/A self N/A N/A N/A N/A N/A self setUpWithSecondChecker N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event2.html N/A N/A N/A N/A self event save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 0 N/A test_x_path_type_x_path_second_delete_double N/A N/A self N/A N/A N/A N/A N/A self setUpWithSecondChecker N/A N/A N/A self checker checker_x_path //div[@class="oh_my_wrong_xpath_for_delete"]/div/text() N/A N/A N/A N/A self checker save N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event2.html N/A N/A N/A N/A self event save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 0 N/A test_x_path_type_blank_result_field_x_path_delete N/A N/A self N/A N/A N/A N/A N/A self scraper checker_x_path_result N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event2.html N/A N/A N/A N/A self event save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 0 N/A _create_imgs_in_dirs N/A N/A self img_dirs N/A N/A N/A img_paths N/A N/A file_name N/A N/A event_image_{rnd}.jpg format rnd N/A str N/A N/A random randint 0 1000000 N/A N/A N/A self event description file_name N/A N/A N/A N/A self event save N/A img_dir img_dirs N/A N/A path N/A N/A N/A os path join N/A self PROJECT_ROOT img_dir file_name N/A N/A N/A N/A N/A os path exists N/A N/A N/A os path dirname path N/A N/A N/A N/A os makedirs N/A N/A N/A os path dirname path N/A N/A N/A N/A N/A os path exists path N/A N/A file N/A open path w N/A N/A N/A file write Let\s assume this is an image! N/A N/A N/A file close N/A N/A N/A img_paths append path N/A img_paths N/A _run_img_test_with_dirs N/A N/A self img_dirs N/A N/A N/A img_paths N/A N/A self _create_imgs_in_dirs img_dirs N/A N/A N/A self se_desc mandatory True N/A N/A N/A N/A self se_desc save N/A N/A N/A self soa_desc attr_type I N/A N/A N/A N/A self soa_desc save N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event_which_is_not_there.html N/A N/A N/A N/A self event save N/A path img_paths N/A N/A N/A N/A self assertTrue N/A N/A N/A os path exists path N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 0 N/A path img_paths N/A N/A N/A N/A self assertFalse N/A N/A N/A os path exists path N/A test_delete_with_img_flat_no_thumbs N/A N/A self N/A N/A N/A img_dirs N/A imgs/ N/A N/A N/A self _run_img_test_with_dirs img_dirs N/A test_delete_with_img_flat_with_thumbs N/A N/A self N/A N/A N/A img_dirs N/A imgs/ N/A N/A N/A self _run_img_test_with_dirs img_dirs N/A test_delete_with_img_all_no_thumbs N/A N/A self N/A N/A N/A img_dirs N/A imgs/full/ N/A N/A N/A self _run_img_test_with_dirs img_dirs N/A test_delete_with_img_all_with_thumbs N/A N/A self N/A N/A N/A img_dirs N/A imgs/full/ imgs/thumbs/medium/ imgs/thumbs/small/ N/A N/A N/A self _run_img_test_with_dirs img_dirs N/A test_delete_with_img_thumbs_with_thumbs N/A N/A self N/A N/A N/A img_dirs N/A imgs/thumbs/medium/ imgs/thumbs/small/ N/A N/A N/A self _run_img_test_with_dirs img_dirs N/A test_404_type_404_delete N/A N/A self N/A N/A N/A N/A N/A self checker checker_type 4 N/A N/A N/A N/A self checker save N/A N/A N/A self event url http://localhost:8010/static/site_for_checker/event_which_is_not_there.html N/A N/A N/A N/A self event save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 0 N/A test_404_type_x_path_delete N/A N/A self N/A N/A N/A N/A N/A self checker checker_type 4 N/A N/A N/A N/A self checker save N/A N/A N/A self run_event_checker 1 N/A N/A N/A self assertEqual N/A len N/A N/A N/A Event objects all 1 N/A test_checker_test_wrong_checker_config N/A N/A self N/A N/A N/A N/A N/A self checker checker_ref_url N/A N/A N/A N/A self checker save N/A N/A N/A self assertRaises CloseSpider N/A N/A self run_checker_test 1 N/A N/A N/A unittest skip Skipped, CloseSpider can't be catched from within test env, other option: direct access to Scrapy log strings. N/A