Module Expr Str Import alias identifier Import alias Import alias Import alias ImportFrom alias ImportFrom alias alias ImportFrom alias alias alias ImportFrom alias alias ImportFrom alias alias ClassDef bases NameLoad body FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad NameLoad body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad keyword NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Num Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad NameLoad NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults Str body Expr Call AttributeLoad AttributeLoad NameLoad attr attr ListLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assert CompareEq Call NameLoad NameLoad Num Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body If AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr While AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Num Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr If CompareEq NameLoad Str body If UnaryOpNot Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Str Continue TryExcept body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr Str Continue Expr Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr NameLoad orelse If CompareEq NameLoad Str body Expr Call AttributeLoad AttributeLoad NameLoad attr attr If Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Str orelse Expr Call AttributeLoad NameLoad attr Str orelse Expr Call AttributeLoad NameLoad attr Str Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Return Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return SubscriptLoad AttributeLoad AttributeLoad NameLoad attr attr Index Num decorator_list FunctionDef arguments args NameParam defaults body Return Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body If UnaryOpNot AttributeLoad NameLoad attr body Return NameLoad Return UnaryOpNot Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body If UnaryOpNot AttributeLoad NameLoad attr body Return Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr NameLoad decorator_list decorator_list ClassDef bases NameLoad body FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad NameLoad NameLoad body If Call NameLoad NameLoad NameLoad body Assign NameStore Call NameLoad NameLoad NameLoad If UnaryOpNot NameLoad body Assign NameStore SubscriptLoad Call AttributeLoad AttributeLoad SubscriptLoad AttributeLoad NameLoad attr Index AttributeLoad NameLoad attr attr attr Str Num Index Num Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad BinOpMod Str TupleLoad Call AttributeLoad NameLoad attr NameLoad If NameLoad body Assign NameStore Call AttributeLoad NameLoad attr For TupleStore NameStore NameStore Call NameLoad Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad NameLoad NameLoad AugAssignAdd NameStore BinOpMod Str Call AttributeLoad NameLoad attr AugAssignAdd NameStore Str Print NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad If NameLoad body Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr orelse Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body ImportFrom alias alias alias alias alias alias Assign NameStore Call NameLoad Call NameLoad AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore BinOpMod Str TupleLoad NameLoad NameLoad Assign NameStore Call NameLoad keyword Lambda arguments args NameParam defaults BinOpMod NameLoad TupleLoad Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore ListLoad Str Call NameLoad Str NameLoad Str Call NameLoad Str Call NameLoad Assign NameStore Call NameLoad keyword NameLoad keyword NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body If Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str AttributeLoad NameLoad attr With Call NameLoad AttributeLoad NameLoad attr Str NameStore body TryExcept body Return Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler type NameLoad body Pass ExceptHandler type NameLoad name NameStore body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Return Dict decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad body Assign NameStore Call NameLoad NameLoad Str NameLoad If AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If CompareEq NameLoad NameLoad body Return If UnaryOpNot NameLoad body Return Assign NameStore NameLoad Assign NameStore Dict Str Str NameLoad NameLoad With Call NameLoad BinOpAdd AttributeLoad NameLoad attr Str Str NameStore body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad Expr Call NameLoad BinOpAdd AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body While Call AttributeLoad AttributeLoad NameLoad attr attr body Expr Call AttributeLoad NameLoad attr Num TryExcept body Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad Continue Expr Call AttributeLoad NameLoad attr NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body If Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Expr Call NameLoad AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body If AttributeLoad NameLoad attr body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr orelse Assign NameStore Dict Assign NameStore Call AttributeLoad NameLoad attr If NameLoad body Assign SubscriptStore NameLoad Index Str SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str orelse Assign NameStore Num Expr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num If AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign TupleStore NameStore NameStore TupleLoad NameLoad NameLoad For TupleStore NameStore NameStore Call NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad body Expr Call AttributeLoad AttributeLoad NameLoad attr attr TupleLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr While Call AttributeLoad AttributeLoad NameLoad attr attr body Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr NameLoad NameLoad If AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list decorator_list
N/A N/A 
taskmaster.controller
~~~~~~~~~~~~~~~~~~~~~

:copyright: (c) 2010 DISQUS.
:license: Apache License 2.0, see LICENSE for more details.
 N/A cPickle pickle N/A gevent N/A hashlib N/A sys gevent_zeromq zmq gevent.queue Queue Empty os path unlink rename taskmaster.constants DEFAULT_LOG_LEVEL DEFAULT_ITERATOR_TARGET taskmaster.util import_target get_logger Server N/A object N/A __init__ N/A N/A self address size log_level N/A None DEFAULT_LOG_LEVEL N/A N/A N/A self daemon True N/A N/A self started False N/A N/A self size size N/A N/A self queue N/A Queue maxsize size N/A N/A self address address N/A N/A self context N/A N/A zmq Context 1 N/A N/A self server None N/A N/A self logger N/A get_logger self log_level N/A N/A self _has_fetched_jobs False N/A send N/A N/A self cmd data N/A N/A N/A N/A N/A N/A self server send_multipart N/A cmd data N/A recv N/A N/A self N/A N/A N/A reply N/A N/A N/A self server recv_multipart N/A N/A N/A len reply 2 N/A reply N/A bind N/A N/A self N/A N/A N/A N/A self server N/A N/A N/A N/A N/A self server close N/A N/A self server N/A N/A N/A self context socket N/A zmq REP N/A N/A N/A N/A self server bind N/A self address N/A start N/A N/A self N/A N/A N/A N/A self started True N/A N/A N/A N/A self logger info Taskmaster binding to %r N/A self address N/A N/A N/A self bind N/A N/A self started N/A N/A N/A N/A gevent sleep 0 N/A N/A cmd data N/A N/A self recv N/A N/A cmd GET N/A N/A N/A N/A N/A self has_work N/A N/A N/A N/A self send QUIT N/A N/A N/A N/A job N/A N/A N/A self queue get_nowait N/A N/A N/A Empty N/A N/A N/A N/A self send WAIT N/A N/A N/A N/A self send OK N/A N/A pickle dumps job N/A N/A N/A cmd DONE N/A N/A N/A N/A N/A self queue task_done N/A N/A N/A self has_work N/A N/A N/A N/A self send OK N/A N/A N/A N/A self send QUIT N/A N/A N/A N/A self send ERROR Unrecognized command N/A N/A N/A N/A self logger info Shutting down N/A N/A N/A self shutdown N/A mark_queue_filled N/A N/A self N/A N/A N/A N/A self _has_fetched_jobs True N/A put_job N/A N/A self job N/A N/A N/A N/A N/A N/A self queue put job N/A first_job N/A N/A self N/A N/A N/A N/A N/A N/A self queue queue N/A 0 N/A get_current_size N/A N/A self N/A N/A N/A N/A N/A N/A self queue qsize N/A get_max_size N/A N/A self N/A N/A N/A N/A self size N/A has_work N/A N/A self N/A N/A N/A N/A N/A self _has_fetched_jobs N/A N/A True N/A N/A N/A N/A N/A self queue empty N/A is_alive N/A N/A self N/A N/A N/A N/A self started N/A shutdown N/A N/A self N/A N/A N/A N/A N/A self started N/A N/A N/A N/A N/A N/A self server close N/A N/A N/A N/A self context term N/A N/A self started False N/A N/A Controller N/A object N/A __init__ N/A N/A self server target kwargs state_file progressbar log_level N/A None None True DEFAULT_LOG_LEVEL N/A N/A N/A isinstance target basestring N/A N/A target N/A import_target target DEFAULT_ITERATOR_TARGET N/A N/A state_file N/A N/A target_file N/A N/A N/A N/A N/A N/A sys modules N/A N/A target __module__ __file__ rsplit . 1 N/A 0 N/A state_file N/A N/A path join N/A N/A path dirname target_file N/A %s N/A N/A N/A path basename target_file N/A kwargs N/A N/A checksum N/A N/A hashlib md5 N/A N/A k v N/A sorted N/A N/A kwargs items N/A N/A N/A N/A checksum update N/A %s=%s N/A k v N/A state_file N/A .%s N/A N/A checksum hexdigest N/A state_file .state N/A state_file N/A N/A self server server N/A N/A self target target N/A N/A self target_kwargs kwargs N/A N/A self state_file state_file N/A progressbar N/A N/A N/A self pbar N/A N/A self get_progressbar N/A N/A N/A self pbar None N/A N/A self logger N/A get_logger self log_level N/A get_progressbar N/A N/A self N/A N/A taskmaster.progressbar Counter Speed Timer ProgressBar UnknownLength Value N/A sizelen N/A len N/A str N/A N/A self server size N/A format N/A In-Queue: %%-%ds / %%-%ds N/A sizelen sizelen N/A queue_size N/A Value callback N/A N/A N/A x N/A N/A format N/A N/A N/A N/A self server get_current_size N/A N/A N/A self server get_max_size N/A widgets N/A Completed Tasks:  N/A Counter  |  queue_size  |  N/A Speed  |  N/A Timer N/A pbar N/A ProgressBar widgets widgets maxval UnknownLength N/A pbar N/A read_state N/A N/A self N/A N/A N/A N/A N/A path exists N/A self state_file N/A N/A N/A N/A N/A self logger info Reading previous state from %r N/A self state_file N/A N/A open N/A self state_file r fp N/A N/A N/A N/A N/A N/A pickle load fp N/A N/A N/A EOFError N/A N/A N/A N/A Exception N/A e N/A N/A N/A N/A N/A self logger exception There was an error reading from state file. Ignoring and continuing without.
%s e N/A N/A N/A update_state N/A N/A self job_id job fp N/A None N/A N/A last_job_id N/A getattr self _last_job_id None N/A N/A self pbar N/A N/A N/A N/A N/A self pbar update job_id N/A N/A job_id last_job_id N/A N/A N/A N/A job N/A N/A N/A last_job_id job_id N/A data N/A job job_id job job_id N/A N/A open N/A N/A self state_file .tmp w fp N/A N/A N/A N/A pickle dump data fp N/A N/A rename N/A N/A self state_file .tmp N/A self state_file N/A state_writer N/A N/A self N/A N/A N/A N/A N/A N/A self server is_alive N/A N/A N/A N/A gevent sleep 0.01 N/A N/A N/A N/A job_id job N/A N/A N/A self server first_job N/A N/A N/A IndexError N/A N/A N/A N/A self update_state None None N/A N/A N/A N/A self update_state job_id job N/A reset N/A N/A self N/A N/A N/A N/A N/A path exists N/A self state_file N/A N/A N/A unlink N/A self state_file N/A start N/A N/A self N/A N/A N/A N/A self target_kwargs N/A N/A kwargs N/A N/A N/A self target_kwargs copy N/A N/A kwargs N/A N/A last_job N/A N/A self read_state N/A last_job N/A N/A N/A kwargs N/A last N/A last_job N/A job N/A start_id N/A last_job N/A job_id N/A N/A start_id 0 N/A N/A N/A gevent spawn N/A N/A self server start N/A N/A N/A gevent sleep 0 N/A N/A self pbar N/A N/A N/A N/A N/A self pbar start N/A N/A N/A N/A self pbar update start_id N/A state_writer N/A N/A gevent spawn N/A self state_writer N/A N/A job_id job N/A None None N/A N/A job_id job N/A enumerate N/A N/A self target kwargs start_id N/A N/A N/A N/A N/A self server put_job N/A job_id job N/A N/A N/A gevent sleep 0 N/A N/A N/A N/A self server mark_queue_filled N/A N/A N/A N/A self server has_work N/A N/A N/A N/A gevent sleep 0.01 N/A N/A N/A gevent sleep 3 N/A N/A N/A N/A self server shutdown N/A N/A N/A state_writer join 1 N/A N/A N/A self update_state job_id job N/A N/A self pbar N/A N/A N/A N/A N/A self pbar finish N/A N/A