Module Import alias Import alias ImportFrom alias alias Import alias Import alias ImportFrom alias ImportFrom alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias alias ClassDef bases NameLoad body FunctionDef arguments args NameParam NameParam defaults NameLoad body Assign AttributeStore NameLoad attr NameLoad decorator_list decorator_list ClassDef bases NameLoad body FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr Str decorator_list decorator_list ClassDef bases NameLoad body FunctionDef arguments args NameParam NameParam NameParam NameParam defaults Str body If Call NameLoad NameLoad NameLoad body Assign AttributeStore NameLoad attr Call NameLoad keyword NameLoad NameLoad orelse Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad ListComp Call AttributeLoad NameLoad attr comprehension NameStore Call AttributeLoad Call AttributeLoad NameLoad attr Str Str attr Str Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad Call AttributeLoad NameLoad attr Str Str Assign AttributeStore NameLoad attr Call NameLoad Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr SubscriptLoad NameLoad Index Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Str Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Str Str decorator_list FunctionDef arguments args NameParam defaults body If CompareIs AttributeLoad NameLoad attr NameLoad body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str If CompareIs NameLoad NameLoad body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Dict Assign NameStore Call AttributeLoad NameLoad attr Str Str If NameLoad body Assign NameStore Call NameLoad BinOpMod Str NameLoad keyword Str orelse Assign NameStore NameLoad Assign AttributeStore NameLoad attr Call NameLoad NameLoad AttributeLoad NameLoad attr keyword Num keyword AttributeLoad NameLoad attr Return AttributeLoad NameLoad attr decorator_list NameLoad FunctionDef arguments args NameParam defaults body If CompareEq AttributeLoad NameLoad attr Num body Assign NameStore NameLoad Assign NameStore NameLoad orelse Assign NameStore Call NameLoad keyword AttributeLoad NameLoad attr Assign NameStore BinOpSub Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str If CompareEq AttributeLoad NameLoad attr Num body Assign NameStore NameLoad orelse Assign NameStore Call NameLoad keyword AttributeLoad NameLoad attr Assign NameStore BinOpAdd BinOpSub Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpMod Str NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpMod Str NameLoad Return TupleLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body TryExcept body Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword NameLoad Assign NameStore Call AttributeLoad Str attr GeneratorExp NameLoad comprehension NameStore NameLoad If NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad orelse Assign NameStore Call NameLoad handlers ExceptHandler type NameLoad name NameStore body If CompareEq AttributeLoad NameLoad attr Num body Assign NameStore Call NameLoad orelse Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call NameLoad Str Return Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpMod Call NameLoad Str Call NameLoad NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad Return Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad body Expr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpMod Str TupleLoad NameLoad NameLoad NameLoad NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad NameLoad If BoolOpOr CompareLt NameLoad Num CompareGtE NameLoad Num body Raise Call NameLoad NameLoad Assign NameStore Str Assign NameStore Str Assign NameStore Call AttributeLoad NameLoad attr BinOpAdd Num AttributeLoad NameLoad attr TryExcept body For NameStore NameLoad body If NameLoad body TryExcept body Assign NameStore Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler type AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpMod Call NameLoad Str Call AttributeLoad Str attr TupleLoad NameLoad NameLoad NameLoad Raise Call NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str Assign SubscriptStore NameLoad Index Num BinOpAdd NameLoad SubscriptLoad NameLoad Index Num For NameStore SubscriptLoad NameLoad Slice Num body Expr Yield NameLoad Assign NameStore SubscriptLoad NameLoad Index Num If NameLoad body Expr Yield NameLoad handlers ExceptHandler type NameLoad body Raise Call NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad NameLoad body Expr Str Assign NameStore NameLoad If CompareIsNot NameLoad NameLoad body TryExcept body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Str handlers ExceptHandler type NameLoad body Pass orelse Assign NameStore BinOpMod Str AttributeLoad NameLoad attr Assign NameStore BinOpMod Str AttributeLoad NameLoad attr Assign NameStore BinOpMod Str AttributeLoad NameLoad attr Assign NameStore BinOpMod Str AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad Str attr ListLoad NameLoad NameLoad NameLoad NameLoad Assign NameStore NameLoad If CompareIsNot NameLoad NameLoad body TryExcept body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Str handlers ExceptHandler type NameLoad body Pass orelse Assign NameStore BinOpMod Str AttributeLoad NameLoad attr Assign NameStore BinOpMod Str AttributeLoad NameLoad attr Assign NameStore BinOpMod Str AttributeLoad NameLoad attr Assign NameStore BinOpMod Str BinOpAdd AttributeLoad NameLoad attr Num Assign NameStore Call AttributeLoad Str attr ListLoad NameLoad NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad keyword NameLoad keyword NameLoad Assign NameStore ListLoad If CompareIs NameLoad NameLoad body Assign NameStore Call NameLoad For NameStore NameLoad body Assign NameStore SubscriptLoad NameLoad Index Str If CompareNotIn NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Return NameLoad decorator_list decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad body Expr Str Assign NameStore ListLoad Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr For NameStore Call NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad keyword TupleLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad For NameStore Call NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr While NameLoad body TryExcept body Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr handlers ExceptHandler type AttributeLoad NameLoad attr body Expr Call NameLoad Num ExceptHandler type NameLoad body If NameLoad body Expr Call AttributeLoad NameLoad attr Str orelse If Call NameLoad NameLoad NameLoad body If NameLoad body Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr orelse Expr Yield TupleLoad NameLoad NameLoad If BoolOpAnd UnaryOpNot Call NameLoad GeneratorExp Call AttributeLoad NameLoad attr comprehension NameStore NameLoad Call AttributeLoad NameLoad attr body Break decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad body Expr Str TryFinally body TryExcept body Assign NameStore Call NameLoad NameLoad While NameLoad body Assign NameStore Call AttributeLoad NameLoad attr If CompareIs NameLoad NameLoad body Break TryExcept body Assign NameStore Call NameLoad NameLoad NameLoad handlers ExceptHandler type NameLoad body Return TryExcept body Assign NameStore Call NameLoad NameLoad handlers ExceptHandler body Assign TupleStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad Str attr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr TupleLoad NameLoad NameLoad handlers ExceptHandler type NameLoad name NameStore body If NameLoad body Expr Call AttributeLoad NameLoad attr Str finalbody Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr decorator_list
N/A N/A multiprocessing N/A Queue datetime datetime timedelta N/A zlib N/A time paste.deploy appconfig contextlib contextmanager N/A os N/A errno N/A fcntl N/A sys N/A traceback N/A cPickle N/A cStringIO eventlet sleep swift.common.memcached MemcacheRing slogging.internal_proxy InternalProxy swift.common.utils get_logger swift.common.exceptions ChunkReadTimeout LockTimeout BadFileDownload N/A Exception N/A __init__ N/A N/A self status_code N/A None N/A N/A N/A self status_code status_code N/A N/A WorkerError N/A Exception N/A __init__ N/A N/A self N/A N/A N/A N/A self tb_str N/A N/A LogProcessorCommon N/A object N/A __init__ N/A N/A self conf logger log_route N/A log-processor N/A N/A N/A isinstance logger tuple N/A N/A N/A self logger N/A get_logger log_route log_route logger N/A N/A N/A self logger logger N/A N/A self memcache N/A MemcacheRing N/A N/A N/A s strip N/A s N/A N/A N/A N/A conf get memcache_servers split , N/A N/A s strip N/A N/A self conf conf N/A N/A self _internal_proxy None N/A N/A self lookback_hours N/A int N/A N/A conf get lookback_hours 120 N/A N/A self lookback_window N/A int N/A N/A conf get lookback_window N/A self lookback_hours N/A N/A self log_processor_account N/A conf N/A swift_account N/A N/A self log_processor_container N/A N/A conf get container_name simple_billing_data N/A N/A self processed_files_object_name N/A N/A conf get processed_files_object_name processed_files.pickle.gz N/A internal_proxy N/A N/A self N/A N/A N/A N/A N/A self _internal_proxy None N/A N/A proxy_server_conf_loc N/A N/A N/A self conf get proxy_server_conf N/A N/A proxy_server_conf_loc None N/A N/A stats_conf N/A N/A N/A self conf get log-processor N/A N/A proxy_server_conf_loc N/A N/A stats_conf get proxy_server_conf /etc/swift/proxy-server.conf N/A proxy_server_conf_loc N/A N/A proxy_server_conf N/A appconfig N/A config:%s proxy_server_conf_loc name proxy-server N/A N/A proxy_server_conf None N/A N/A self _internal_proxy N/A InternalProxy proxy_server_conf N/A self logger retries 3 memcache N/A self memcache N/A N/A self _internal_proxy N/A property calculate_lookback N/A N/A self N/A N/A N/A N/A N/A self lookback_hours 0 N/A N/A lookback_start None N/A lookback_end None N/A N/A delta_hours N/A timedelta hours N/A self lookback_hours N/A lookback_start N/A N/A N/A datetime now delta_hours N/A lookback_start N/A N/A lookback_start strftime %Y%m%d%H N/A N/A N/A self lookback_window 0 N/A N/A lookback_end None N/A N/A delta_window N/A timedelta hours N/A self lookback_window N/A lookback_end N/A N/A N/A N/A datetime now delta_hours delta_window N/A lookback_end N/A N/A lookback_end strftime %Y%m%d%H N/A N/A N/A N/A self logger debug N/A lookback_start: %s lookback_start N/A N/A N/A N/A self logger debug N/A lookback_end: %s lookback_end N/A N/A lookback_start lookback_end N/A load_already_processed_files N/A N/A self N/A N/A N/A N/A N/A processed_files_stream N/A N/A self get_object_data N/A self log_processor_account N/A self log_processor_container N/A self processed_files_object_name compressed True N/A buf N/A N/A join N/A x N/A x processed_files_stream N/A buf N/A N/A already_processed_files N/A N/A cPickle loads buf N/A N/A already_processed_files N/A set N/A N/A N/A BadFileDownload N/A err N/A N/A N/A N/A err status_code 404 N/A N/A already_processed_files N/A set N/A N/A N/A N/A N/A self logger error N/A _ Simple billing unable to load list of already processed log files N/A N/A N/A N/A N/A self logger debug N/A N/A _ found %d processed files N/A len already_processed_files N/A already_processed_files N/A save_processed_files N/A N/A self processed_files_data N/A N/A N/A s N/A N/A cPickle dumps processed_files_data N/A cPickle HIGHEST_PROTOCOL N/A f N/A N/A cStringIO StringIO s N/A N/A N/A N/A self internal_proxy upload_file f N/A self log_processor_account N/A self log_processor_container N/A self processed_files_object_name N/A get_object_data N/A N/A self swift_account container_name object_name compressed N/A False N/A N/A reads an object and yields its lines N/A N/A N/A N/A self logger debug N/A get_object_data(%r, %r, %r, compressed=%r) N/A swift_account container_name object_name compressed N/A N/A code o N/A N/A N/A self internal_proxy get_object swift_account container_name object_name N/A N/A N/A code 200 N/A code 300 N/A N/A N/A BadFileDownload code N/A last_part N/A last_compressed_part N/A d N/A N/A zlib decompressobj N/A 16 N/A zlib MAX_WBITS N/A N/A N/A chunk o N/A N/A compressed N/A N/A N/A N/A chunk N/A N/A d decompress chunk N/A N/A N/A N/A zlib error N/A N/A N/A N/A N/A self logger debug N/A N/A _ Bad compressed data for %s N/A N/A / join N/A swift_account container_name object_name N/A N/A BadFileDownload N/A parts N/A N/A chunk split N/A N/A parts N/A 0 N/A last_part N/A parts N/A 0 N/A part N/A parts N/A -1 N/A N/A N/A part N/A last_part N/A parts N/A -1 N/A last_part N/A N/A N/A last_part N/A N/A N/A ChunkReadTimeout N/A N/A N/A BadFileDownload N/A get_container_listing N/A N/A self swift_account container_name start_date end_date listing_filter N/A None None None N/A N/A 
        Get a container listing, filtered by start_date, end_date, and
        listing_filter. Dates, if given, must be in YYYYMMDDHH format
         N/A search_key None N/A N/A start_date None N/A N/A N/A N/A parsed_date N/A N/A time strptime start_date %Y%m%d%H N/A N/A N/A ValueError N/A N/A N/A N/A year N/A %04d N/A parsed_date tm_year N/A month N/A %02d N/A parsed_date tm_mon N/A day N/A %02d N/A parsed_date tm_mday N/A hour N/A %02d N/A parsed_date tm_hour N/A search_key N/A N/A / join N/A year month day hour N/A end_key None N/A N/A end_date None N/A N/A N/A N/A parsed_date N/A N/A time strptime end_date %Y%m%d%H N/A N/A N/A ValueError N/A N/A N/A N/A year N/A %04d N/A parsed_date tm_year N/A month N/A %02d N/A parsed_date tm_mon N/A day N/A %02d N/A parsed_date tm_mday N/A hour N/A %02d N/A N/A parsed_date tm_hour 1 N/A end_key N/A N/A / join N/A year month day hour N/A container_listing N/A N/A N/A self internal_proxy get_container_list swift_account container_name marker search_key end_marker end_key N/A results N/A N/A N/A listing_filter None N/A N/A listing_filter N/A set N/A item container_listing N/A N/A name N/A item N/A name N/A N/A name listing_filter N/A N/A N/A N/A results append name N/A results N/A N/A multiprocess_collate N/A N/A processor_klass processor_args processor_method items_to_process worker_count logger N/A None N/A N/A N/A results N/A N/A in_queue N/A N/A multiprocessing Queue N/A out_queue N/A N/A multiprocessing Queue N/A _junk N/A range worker_count N/A N/A p N/A N/A multiprocessing Process target collate_worker args N/A processor_klass processor_args processor_method in_queue out_queue logger N/A N/A N/A p start N/A N/A N/A results append p N/A x items_to_process N/A N/A N/A N/A in_queue put x N/A _junk N/A range worker_count N/A N/A N/A N/A in_queue put None N/A N/A N/A in_queue close N/A True N/A N/A N/A N/A N/A item data N/A N/A out_queue get_nowait N/A N/A N/A N/A Queue Empty N/A N/A N/A sleep 0.01 N/A N/A Exception N/A N/A logger N/A N/A N/A N/A logger exception error reading from out queue N/A N/A N/A isinstance data WorkerError N/A N/A logger N/A N/A N/A N/A logger error N/A data tb_str N/A N/A N/A N/A item data N/A N/A N/A N/A any N/A N/A N/A r is_alive N/A r results N/A N/A out_queue empty N/A N/A N/A collate_worker N/A N/A processor_klass processor_args processor_method in_queue out_queue logger N/A None N/A N/A worker process for multiprocess_collate N/A N/A N/A N/A N/A p N/A processor_klass processor_args N/A True N/A N/A item N/A N/A in_queue get N/A N/A item None N/A N/A N/A N/A N/A method N/A getattr p processor_method N/A N/A N/A AttributeError N/A N/A N/A N/A N/A ret N/A method item N/A N/A N/A N/A N/A err_type err tb N/A N/A sys exc_info N/A ret N/A WorkerError N/A N/A ret tb_str N/A N/A join N/A N/A traceback format_tb tb N/A N/A N/A out_queue put N/A item ret N/A N/A N/A Exception N/A err N/A N/A logger N/A N/A N/A N/A logger exception Error in worker N/A N/A N/A N/A in_queue close N/A N/A N/A out_queue close N/A