Module Import alias Import alias Assign NameStore Str Expr Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Str Import alias Import alias Assign NameStore ListLoad Str Str ClassDef bases body Assign NameStore Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str NameLoad Str Call NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str orelse Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call NameLoad NameLoad Str NameLoad Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str orelse Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call NameLoad NameLoad Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If CompareEq Call NameLoad NameLoad Num body Return NameLoad orelse Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str NameLoad Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str orelse Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad body Assign NameStore Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr Str Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad If NameLoad body Assign NameStore Str orelse Assign NameStore Str Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd NameLoad Str NameLoad Str Call AttributeLoad Str attr Call AttributeLoad NameLoad attr Str Assign NameStore Call NameLoad For TupleStore NameStore NameStore Call AttributeLoad NameLoad attr body Assign NameStore Call AttributeLoad Call NameLoad NameLoad attr Str Str Expr Call AttributeLoad NameLoad attr BinOpAdd BinOpAdd Str Call AttributeLoad AttributeLoad NameLoad attr attr Str Call NameLoad NameLoad Str AugAssignAdd NameStore BinOpAdd BinOpAdd Str Call AttributeLoad Str attr NameLoad Str Print NameLoad Return Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad SubscriptLoad NameLoad Index Str Str SubscriptLoad NameLoad Index Str Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str orelse Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call NameLoad For TupleStore NameStore NameStore Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr BinOpAdd BinOpAdd NameLoad Str Call NameLoad NameLoad Assign NameStore BinOpAdd Str Call AttributeLoad Str attr NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If CompareGt Call NameLoad NameLoad Num body Return Expr Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad body Assign NameStore Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr Str For NameStore NameLoad body Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign NameStore Str If NameLoad body Assign NameStore Str Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd NameLoad Str NameLoad Str Call AttributeLoad Str attr Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Assign NameStore Call NameLoad For NameStore NameLoad body Assign NameStore Call NameLoad For TupleStore NameStore NameStore Call AttributeLoad NameLoad attr body If BoolOpOr Call NameLoad NameLoad NameLoad Call NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr BinOpAdd BinOpAdd Str NameLoad Str orelse Expr Call AttributeLoad NameLoad attr Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr BinOpAdd BinOpAdd Str Call AttributeLoad Str attr NameLoad Str AugAssignAdd NameStore Call AttributeLoad Str attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call NameLoad NameLoad Str Call NameLoad NameLoad Str NameLoad Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str orelse Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad If NameLoad body Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore Call NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Num Num SubscriptLoad NameLoad Index Str Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Num NameLoad SubscriptLoad NameLoad Index Str Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Num Assign NameStore NameLoad Assign NameStore ListLoad Str Str Str For NameStore NameLoad body If UnaryOpNot CompareIn NameLoad Call AttributeLoad NameLoad attr body Break Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad SubscriptLoad NameLoad Index NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore NameLoad AugAssignAdd NameStore Num Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr Str Expr Call AttributeLoad NameLoad attr Str NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore Call NameLoad For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Str Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body If UnaryOpNot NameLoad body Return NameLoad Assign NameStore Call NameLoad For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call AttributeLoad Str attr NameLoad Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call NameLoad NameLoad Str NameLoad Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore BinOpMod Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore ListLoad For NameStore NameLoad body If BoolOpOr Call NameLoad NameLoad NameLoad Call NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad orelse Expr Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call AttributeLoad Str attr NameLoad Str Return Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd Str NameLoad Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str orelse Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad SubscriptLoad NameLoad Index Str Str SubscriptLoad NameLoad Index Str Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str orelse Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Assign NameStore BinOpAdd Str Call NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str orelse Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults Str body Assign NameStore Call NameLoad For NameStore NameLoad body AugAssignAdd NameStore BinOpAdd BinOpAdd BinOpAdd NameLoad Str Call NameLoad SubscriptLoad NameLoad Index NameLoad Str Assign NameStore Num If NameLoad body Assign NameStore BinOpMod Str TupleLoad NameLoad SubscriptLoad NameLoad Slice Num Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Assign NameStore SubscriptLoad SubscriptLoad NameLoad Index Num Index NameLoad If CompareGt NameLoad Num body Assign NameStore Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr Str Assign SubscriptStore NameLoad Index Str NameLoad Assign NameStore Call NameLoad For TupleStore NameStore NameStore Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad NameLoad Call NameLoad NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpMod Str TupleLoad NameLoad Call AttributeLoad Str attr NameLoad BinOpMod Str TupleLoad NameLoad NameLoad orelse Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call NameLoad NameLoad Str Call NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str orelse Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str NameLoad Str NameLoad Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad If NameLoad body Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call NameLoad NameLoad Str NameLoad Str Call NameLoad NameLoad Str Call NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad If NameLoad body Assign SubscriptStore NameLoad Index Str NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad body Assign NameStore BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call NameLoad NameLoad Str NameLoad Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If NameLoad body Return SubscriptLoad SubscriptLoad NameLoad Index Num Index Str Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Assign SubscriptStore NameLoad Index Str NameLoad If NameLoad body Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad Return Call AttributeLoad NameLoad attr Str NameLoad decorator_list decorator_list
N/A N/A mysql N/A sys N/A __author__ wcong N/A N/A reload sys N/A N/A N/A sys setdefaultencoding utf-8 N/A datetime N/A re N/A db_goods_unique_key N/A source_goods_id source_id CrawlDao N/A N/A N/A html_tag N/A N/A re compile <[^>]+> N/A re S __init__ N/A N/A self N/A N/A N/A conf N/A N/A mysql get_local_conf N/A N/A self db N/A N/A mysql PDBC conf N/A get_attr_key_id N/A N/A self source_id key cate_id N/A N/A N/A sql N/A N/A N/A N/A N/A select id from dw_crawl_attr_key where source_id = N/A str source_id  and name = " key " and cate_id =  N/A str cate_id N/A data N/A N/A N/A self db get_data sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A N/A db_dict N/A dict N/A N/A db_dict N/A source_id source_id N/A N/A db_dict N/A name key N/A N/A db_dict N/A cate_id cate_id N/A N/A N/A self insert_temple dw_crawl_attr_key db_dict N/A get_attr_value_id N/A N/A self source_id key_id value N/A N/A N/A sql N/A N/A N/A N/A N/A N/A select id from dw_crawl_attr_value where source_id = N/A str source_id  and attr_key_id =  N/A str key_id  and name = " value " N/A data N/A N/A N/A self db get_data sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A N/A db_dict N/A dict N/A N/A db_dict N/A source_id source_id N/A N/A db_dict N/A name value N/A N/A db_dict N/A attr_key_id key_id N/A N/A N/A self insert_temple dw_crawl_attr_value db_dict N/A get_goods_id N/A N/A self source_id goods_id N/A N/A N/A sql N/A N/A N/A N/A select id from dw_crawl_goods where source_id =  N/A str source_id  and source_goods_id = " N/A str goods_id " N/A data N/A N/A N/A self db get_data sql N/A N/A N/A len data 0 N/A N/A False N/A N/A N/A N/A data N/A 0 N/A id N/A get_brand_id N/A N/A self source_id name N/A N/A N/A sql N/A N/A N/A N/A select id from dw_crawl_brand where source_id = N/A str source_id  and name = " name " N/A data N/A N/A N/A self db get_data sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A N/A db_dict N/A dict N/A N/A db_dict N/A source_id source_id N/A N/A db_dict N/A name name N/A N/A N/A self insert_temple dw_crawl_brand db_dict N/A insert_temple N/A N/A self table dic replace N/A False N/A N/A gmt N/A N/A N/A N/A N/A datetime datetime now strftime %Y-%m-%d %H:%M:%S N/A N/A dic N/A gmt_create gmt N/A N/A dic N/A gmt_modified gmt N/A replace N/A N/A action replace N/A N/A action insert N/A sql N/A N/A N/A N/A N/A action  into  table ( N/A N/A , join N/A N/A dic keys ) values N/A value_list N/A list N/A N/A key value N/A N/A dic items N/A N/A value N/A N/A N/A str value replace " N/A N/A N/A value_list append N/A N/A " N/A N/A N/A self html_tag sub N/A str value " N/A sql N/A N/A ( N/A N/A , join value_list ) N/A sql N/A N/A N/A N/A self db insert_data sql N/A insert_or_update_goods N/A N/A self dic N/A N/A N/A select_sql N/A N/A N/A N/A select id from dw_crawl_goods where source_id =  N/A str N/A dic N/A source_id  and source_goods_id = " N/A dic N/A source_goods_id " N/A data N/A N/A N/A self db get_data select_sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A N/A N/A N/A self insert_temple dw_crawl_goods dic N/A insert_or_update_goods_attr N/A N/A self dic N/A N/A N/A condition_list N/A list N/A N/A key value N/A N/A dic items N/A N/A N/A N/A condition_list append N/A N/A key  =  N/A str value N/A sql N/A select id from dw_crawl_goods_attr where  N/A N/A  and  join condition_list N/A data N/A N/A N/A self db get_data sql N/A N/A N/A len data 0 N/A N/A N/A N/A N/A self insert_temple dw_crawl_goods_attr dic N/A insert_batch_temple N/A N/A self table batch_list is_replace N/A False N/A N/A gmt N/A N/A N/A N/A N/A datetime datetime now strftime %Y-%m-%d %H:%M:%S N/A i batch_list N/A N/A N/A i N/A gmt_create gmt N/A N/A i N/A gmt_modified gmt N/A action insert N/A is_replace N/A N/A action replace N/A sql N/A N/A N/A N/A N/A action  into  table ( N/A N/A , join N/A N/A N/A batch_list N/A 0 keys ) values N/A value_list N/A list N/A i batch_list N/A N/A inner_value_list N/A list N/A N/A key value N/A N/A i items N/A N/A N/A N/A isinstance value str N/A isinstance value unicode N/A N/A N/A N/A inner_value_list append N/A N/A " value " N/A N/A N/A N/A inner_value_list append N/A str value N/A N/A N/A value_list append N/A N/A ( N/A N/A , join inner_value_list ) N/A sql N/A N/A , join value_list N/A N/A N/A N/A self db exec_data sql N/A get_car_id N/A N/A self source_id level parent_id name remarks N/A None N/A N/A sql N/A N/A N/A N/A N/A N/A N/A N/A select id from dw_crawl_car where source_id =  N/A str source_id  and level =  N/A str level  and parent_id= N/A str parent_id  and name=" name " N/A data N/A N/A N/A self db get_data sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A N/A insert_dic N/A dict N/A N/A insert_dic N/A level N/A str level N/A N/A insert_dic N/A parent_id N/A str parent_id N/A N/A insert_dic N/A name name N/A N/A insert_dic N/A source_id N/A str source_id N/A remarks N/A N/A N/A insert_dic N/A remarks remarks N/A N/A N/A self insert_temple dw_crawl_car insert_dic N/A get_car_type N/A N/A self source_id car_dic N/A N/A N/A car_id_list N/A list N/A brand_id N/A N/A self get_car_id source_id 1 0 N/A car_dic N/A brand N/A N/A N/A car_id_list append brand_id N/A series_id N/A N/A self get_car_id source_id 2 brand_id N/A car_dic N/A series N/A N/A N/A car_id_list append series_id N/A level 3 N/A parent_id series_id N/A key_list N/A power year style N/A key key_list N/A N/A N/A N/A key N/A N/A car_dic keys N/A N/A N/A car_id N/A N/A self get_car_id source_id level parent_id N/A car_dic N/A key N/A N/A N/A car_id_list append car_id N/A parent_id car_id N/A level 1 N/A car_id_list N/A save_goods_price N/A N/A self source_id goods_id price N/A N/A N/A goods_price_dic N/A dict N/A N/A goods_price_dic N/A source_id source_id N/A N/A goods_price_dic N/A goods_id goods_id N/A N/A goods_price_dic N/A price price N/A N/A goods_price_dic N/A crawl_date N/A N/A N/A N/A N/A datetime datetime now strftime %Y-%m-%d N/A N/A N/A self insert_temple dw_crawl_goods_price goods_price_dic True N/A get_all_special_sign N/A N/A self N/A N/A N/A sql select name from db_tqmall_attr_value where key_id = 525  N/A data N/A N/A N/A self db get_data sql N/A special_list N/A list N/A i data N/A N/A N/A N/A special_list append N/A i N/A attr_value N/A special_list N/A get_cate_by_source_pid N/A N/A self source_id pid_list N/A N/A N/A N/A pid_list N/A N/A None N/A tmp_set N/A set N/A e pid_list N/A N/A N/A N/A tmp_set add N/A str e N/A sql N/A N/A N/A N/A select id, source_cate_id, source_pid, level, pid, name from dw_crawl_cate where source_id =  N/A str source_id  and pid in ( N/A N/A , join tmp_set ) N/A data N/A N/A N/A self db get_data sql N/A data N/A get_cate_id_by_name N/A N/A self source_cate_id source_id name N/A N/A N/A sql N/A N/A N/A N/A N/A N/A select id from dw_crawl_cate where source_id= N/A str source_id  and source_cate_id= N/A str source_cate_id  and name=" name " N/A data N/A N/A N/A self db get_data sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A insert_dict N/A dict N/A N/A insert_dict N/A source_cate_id source_cate_id N/A N/A insert_dict N/A source_id N/A str source_id N/A N/A insert_dict N/A name name N/A N/A N/A self insert_temple dw_crawl_cate insert_dict N/A get_cate_by_source N/A N/A self source_id N/A N/A N/A sql N/A select id, source_cate_id, source_pid, level, pid, name, source_cate_link from dw_crawl_cate where source_id = %d source_id N/A data N/A N/A N/A self db get_data sql N/A data N/A get_cate_by_cateids N/A N/A self source_id cate_ids N/A N/A N/A ids N/A N/A id cate_ids N/A N/A N/A N/A isinstance id str N/A isinstance id unicode N/A N/A N/A N/A ids append id N/A N/A N/A N/A ids append N/A str id N/A sql_select N/A N/A N/A N/A select id, cate_id from dw_crawl_cate where source_id =  N/A str source_id  and cate_id in ( N/A N/A , join ids ) N/A N/A N/A N/A self db get_data sql_select N/A get_source_id N/A N/A self name N/A N/A N/A select_sql N/A N/A select id from dw_crawl_source where name = " name " N/A data N/A N/A N/A self db get_data select_sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A N/A db_dict N/A dict N/A N/A db_dict N/A name name N/A N/A N/A self insert_temple dw_crawl_source db_dict N/A get_store_id N/A N/A self db_dict N/A N/A N/A select_sql N/A N/A N/A N/A select id from dw_crawl_store where source_id =  N/A str N/A db_dict N/A source_id  and name = " N/A db_dict N/A name " N/A data N/A N/A N/A self db get_data select_sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A N/A N/A N/A self insert_temple dw_crawl_store db_dict N/A insert_goods_store N/A N/A self source_id goods_id store_id N/A N/A N/A select_sql N/A select id from dw_crawl_goods_store where goods_id =  N/A str goods_id N/A data N/A N/A N/A self db get_data select_sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A N/A db_dict N/A dict N/A N/A db_dict N/A source_id source_id N/A N/A db_dict N/A goods_id goods_id N/A N/A db_dict N/A store_id store_id N/A N/A N/A self insert_temple dw_crawl_goods_store db_dict N/A insert_or_update_template N/A N/A self table db_dict unique_key primary_name N/A id N/A N/A select_sql N/A str N/A key unique_key N/A N/A select_sql N/A N/A N/A key  = " N/A str N/A db_dict N/A key " and  N/A primary_key_id 0 N/A select_sql N/A N/A select_sql N/A select id from %s where %s N/A table N/A select_sql N/A -5 N/A data N/A N/A N/A self db get_data select_sql N/A data N/A N/A primary_key_id N/A N/A data N/A 0 N/A primary_name N/A N/A primary_key_id 0 N/A N/A gmt N/A N/A N/A N/A N/A datetime datetime now strftime %Y-%m-%d %H:%M:%S N/A N/A db_dict N/A gmt_modified gmt N/A value_list N/A list N/A N/A key value N/A N/A db_dict items N/A N/A N/A N/A value_list append N/A %s = "%s" N/A key N/A str value N/A N/A N/A N/A self db exec_data N/A update %s set %s %s N/A table N/A N/A , join value_list N/A  where %s = %d N/A primary_name primary_key_id N/A N/A primary_key_id N/A N/A self insert_temple table db_dict N/A primary_key_id N/A insert_car_goods N/A N/A self source_id car_id goods_id N/A N/A N/A sql N/A N/A N/A N/A N/A select id from dw_crawl_car_goods where source_id =  N/A str source_id  and car_id =  N/A str car_id  and goods_id =  N/A str goods_id N/A data N/A N/A N/A self db get_data sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A N/A db_dict N/A dict N/A N/A db_dict N/A source_id source_id N/A N/A db_dict N/A goods_id goods_id N/A N/A db_dict N/A car_id car_id N/A N/A N/A self insert_temple dw_crawl_car_goods db_dict N/A get_car_service_id N/A N/A self source_id source_service_id cate name suggest N/A N/A N/A sql N/A N/A N/A N/A N/A N/A select id from dw_crawl_car_service where source_id= N/A str source_id  and cate=" cate " and name =" name " N/A data N/A N/A N/A self db get_data sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A db_dict N/A dict N/A N/A db_dict N/A source_id N/A str source_id N/A N/A db_dict N/A cate cate N/A N/A db_dict N/A name name N/A N/A db_dict N/A suggest suggest N/A source_service_id N/A N/A N/A db_dict N/A source_service_id source_service_id N/A N/A N/A self insert_temple dw_crawl_car_service db_dict N/A get_car_run_service_id N/A N/A self source_id car_id firsttime mile service_id service_type service_suggest N/A None N/A N/A sql N/A N/A N/A N/A N/A N/A N/A N/A N/A select id from  dw_crawl_car_run_service where source_id= N/A str source_id  and car_id= N/A str car_id  and firsttime=" firsttime " and mile= N/A str mile  and service_id= N/A str service_id N/A data N/A N/A N/A self db get_data sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A db_dict N/A dict N/A N/A db_dict N/A source_id N/A str source_id N/A N/A db_dict N/A car_id N/A str car_id N/A N/A db_dict N/A firsttime firsttime N/A N/A db_dict N/A mile N/A str mile N/A N/A db_dict N/A service_id N/A str service_id N/A N/A db_dict N/A service_type N/A str service_type N/A service_suggest N/A N/A N/A db_dict N/A service_suggest service_suggest N/A N/A N/A self insert_temple dw_crawl_car_run_service db_dict N/A add_car_run_service_goods N/A N/A self source_id car_run_service_id source_goods_id goods_id N/A None N/A N/A sql N/A N/A N/A N/A N/A N/A select id from dw_crawl_car_run_service_goods where source_id= N/A str source_id  and car_run_service_id= N/A str car_run_service_id  and source_goods_id=" source_goods_id " N/A data N/A N/A N/A self db get_data sql N/A data N/A N/A N/A N/A data N/A 0 N/A id N/A db_dict N/A dict N/A N/A db_dict N/A source_id N/A str source_id N/A N/A db_dict N/A car_run_service_id N/A str car_run_service_id N/A N/A db_dict N/A source_goods_id source_goods_id N/A goods_id N/A N/A N/A db_dict N/A goods_id N/A str goods_id N/A N/A N/A self insert_temple dw_crawl_car_run_service_goods db_dict N/A N/A