Module Import alias Import alias alias alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias identifier ImportFrom alias ImportFrom alias Expr Call AttributeLoad AttributeLoad NameLoad attr attr Num Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad ImportFrom alias alias alias ImportFrom alias ImportFrom alias ImportFrom alias alias alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias Assign NameStore Call AttributeLoad NameLoad attr BinOpMod Str Call AttributeLoad NameLoad attr Assign NameStore BinOpMult Num Num Assign NameStore Num Assign NameStore Num Assign NameStore BinOpMult BinOpMult Num Num Num Assign NameStore Str FunctionDef arguments args NameParam defaults body TryExcept body ImportFrom alias identifier Expr Call NameLoad NameLoad handlers ExceptHandler type NameLoad body Pass decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad body Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr If CompareIsNot NameLoad NameLoad body Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body TryFinally body TryExcept body Expr Call AttributeLoad NameLoad attr Assign TupleStore NameStore NameStore Call NameLoad Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr If Call NameLoad NameLoad body TryExcept body Assign TupleStore NameStore NameStore TupleLoad Num Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler type NameLoad name NameStore body Assign TupleStore NameStore NameStore TupleLoad Num Call AttributeLoad NameLoad attr NameLoad Num orelse Assign TupleStore NameStore NameStore TupleLoad Num Call AttributeLoad NameLoad attr NameLoad Num Assign NameStore Call NameLoad NameLoad If CompareGt Call NameLoad NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr Num NameLoad AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore Call NameLoad NameLoad Str Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad Str attr BinOpAdd ListLoad Call AttributeLoad NameLoad attr SubscriptLoad Call AttributeLoad NameLoad attr Str Slice Num AugAssignAdd NameStore Num Return TupleLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr TupleLoad Call NameLoad TupleLoad NameLoad NameLoad NameLoad Num handlers ExceptHandler type NameLoad name NameStore body Return TupleLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr TupleLoad NameLoad NameLoad NameLoad Num ExceptHandler body Import alias Assign NameStore Call AttributeLoad NameLoad attr Return TupleLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr TupleLoad Call NameLoad NameLoad NameLoad NameLoad Num finalbody Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad decorator_list ClassDef bases AttributeLoad NameLoad attr body Assign NameStore NameLoad FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Return BinOpAdd BinOpAdd AttributeLoad NameLoad attr Str Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults vararg body Pass decorator_list decorator_list FunctionDef arguments args NameParam defaults body If UnaryOpNot Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Str With Call NameLoad NameLoad Str NameStore body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpMod Str TupleLoad Call AttributeLoad NameLoad attr NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad TryExcept body Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr BinOpAdd BinOpAdd NameLoad Str Str attr If CompareEq NameLoad NameLoad body Return NameLoad handlers ExceptHandler type NameLoad name NameStore body Pass Expr Call AttributeLoad NameLoad attr Str NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr TupleLoad Str Num NameLoad Expr Call NameLoad AttributeLoad NameLoad attr Assign NameStore BinOpMod Str TupleLoad Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index Num Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults Str body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore ListLoad NameLoad Assign NameStore ListLoad FunctionDef arguments args NameParam defaults body If UnaryOpNot SubscriptLoad NameLoad Index Num body Assign SubscriptStore NameLoad Index Num Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad SubscriptLoad NameLoad Index Num attr NameLoad Expr Call AttributeLoad SubscriptLoad NameLoad Index Num attr BinOpAdd NameLoad Call AttributeLoad Str attr NameLoad decorator_list While NameLoad body TryExcept body Assign NameStore Call AttributeLoad NameLoad attr If UnaryOpNot NameLoad body Break Expr Call AttributeLoad NameLoad attr NameLoad If Call AttributeLoad NameLoad attr Str body Expr Call NameLoad NameLoad Assign NameStore ListLoad handlers ExceptHandler type NameLoad body Break If NameLoad body Expr Call NameLoad NameLoad If SubscriptLoad NameLoad Index Num body Expr Call AttributeLoad SubscriptLoad NameLoad Index Num attr Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body TryExcept body Import alias Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad SubscriptLoad AttributeLoad NameLoad attr Index Num attr Return BinOpRShift AttributeLoad Call AttributeLoad NameLoad attr attr Num handlers ExceptHandler type NameLoad body Return Num decorator_list FunctionDef arguments args NameParam defaults body For NameStore AttributeLoad NameLoad attr body If CompareEq AttributeLoad NameLoad attr Str body Return AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr Return Num decorator_list FunctionDef arguments args NameParam defaults body FunctionDef arguments args NameParam defaults vararg kwarg body With AttributeLoad NameLoad attr body Assign NameStore Call NameLoad NameLoad NameLoad NameLoad Return NameLoad decorator_list Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr If CompareEq NameLoad Num body Expr Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr If CompareEq NameLoad Num body TryExcept body Import alias handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr Num TryFinally body TryExcept body Expr Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad name NameStore body Pass finalbody For NameStore NameLoad body While Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad body TryExcept body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad handlers ExceptHandler body Pass Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr decorator_list ClassDef bases NameLoad body FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr ListLoad Assign AttributeStore NameLoad attr ListLoad Assign AttributeStore NameLoad attr Dict Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Assign TupleStore AttributeStore NameLoad attr NameStore Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad Str Num Expr Call AttributeLoad NameLoad attr Num Assert CompareEq Call AttributeLoad NameLoad attr NameLoad Num Str Assign TupleStore AttributeStore NameLoad attr NameStore Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad Str Num Expr Call AttributeLoad NameLoad attr Num Assert CompareEq Call AttributeLoad NameLoad attr NameLoad Num Str decorator_list FunctionDef arguments args NameParam NameParam defaults body TryExcept body Import alias handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr Str Return Assign NameStore Dict Assign NameStore Call AttributeLoad NameLoad attr While NameLoad body Expr Call AttributeLoad AttributeLoad NameLoad attr attr For TupleStore NameStore TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr body Assign NameStore AttributeLoad NameLoad attr TryExcept body Assign NameStore AttributeLoad SubscriptLoad AttributeLoad NameLoad attr Index Num attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpRShift AttributeLoad Call AttributeLoad NameLoad attr attr Num handlers ExceptHandler type NameLoad name NameStore body Expr Call AttributeLoad NameLoad attr Str NameLoad NameLoad NameLoad Expr Call NameLoad NameLoad NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Continue If BoolOpOr CompareEq AttributeLoad NameLoad attr AttributeLoad NameLoad attr UnaryOpNot Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Str NameLoad NameLoad Expr Call NameLoad NameLoad NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Continue Assign NameStore Call NameLoad NameLoad If UnaryOpNot NameLoad body Continue If CompareGt NameLoad BinOpMult NameLoad Num body Expr Call AttributeLoad NameLoad attr BinOpAdd Str Str NameLoad NameLoad NameLoad Expr Call NameLoad NameLoad NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad NameLoad attr orelse If CompareGt NameLoad BinOpMult NameLoad Call AttributeLoad NameLoad attr NameLoad Num body Expr Call AttributeLoad NameLoad attr BinOpAdd Str Str NameLoad NameLoad NameLoad Assign SubscriptStore NameLoad Index NameLoad BinOpAdd BinOpDiv NameLoad NameLoad Num Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad ListComp Num comprehension TupleStore NameStore NameStore AttributeLoad NameLoad attr CompareLt BinOpAdd NameLoad NameLoad NameLoad If NameLoad body For TupleStore NameStore NameStore SubscriptLoad AttributeLoad NameLoad attr Slice NameLoad body Expr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Slice NameLoad If BoolOpOr AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Assign NameStore NameLoad orelse If CompareLt BinOpAdd NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults body TryExcept body Global identifier Assign TupleStore NameStore NameStore NameStore NameStore AttributeStore NameLoad attr NameStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call NameLoad NameLoad Assign NameStore BinOpMod Str Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call NameLoad NameLoad AttributeLoad NameLoad attr NameLoad NameLoad Assign AttributeStore NameLoad attr Call NameLoad NameLoad AttributeLoad NameLoad attr NameLoad NameLoad Expr Call AttributeLoad NameLoad attr keyword Str keyword NameLoad If Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad body TryExcept body Expr Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler type NameLoad name NameStore body Expr Call AttributeLoad NameLoad attr Str NameLoad NameLoad orelse Expr Call AttributeLoad NameLoad attr Str NameLoad Assign AttributeStore NameLoad attr SubscriptLoad NameLoad Index Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr SubscriptLoad AttributeLoad NameLoad attr Index Num If UnaryOpNot Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Num Assign SubscriptStore NameLoad Index Str Call NameLoad SubscriptLoad AttributeLoad NameLoad attr Index Num If CompareIn Str AttributeLoad NameLoad attr body Expr Call NameLoad AttributeLoad NameLoad attr Expr Call NameLoad AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad name NameStore body Import alias Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str NameLoad Raise decorator_list NameLoad FunctionDef arguments args NameParam defaults body TryExcept body Return SubscriptLoad Call AttributeLoad AttributeLoad NameLoad attr attr Index Num handlers ExceptHandler type NameLoad body Assign NameStore Call AttributeLoad NameLoad attr Num NameLoad ListLoad AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore AttributeLoad NameLoad attr Expr Call NameLoad NameLoad NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str AttributeLoad AttributeLoad NameLoad attr attr TryExcept body FunctionDef arguments args TupleStore NameStore NameStore defaults body Expr Call NameLoad NameLoad NameLoad NameLoad NameLoad With AttributeLoad NameLoad attr body Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr AugAssignAdd AttributeStore NameLoad attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr TupleLoad Call AttributeLoad NameLoad attr NameLoad decorator_list Assign NameStore Call AttributeLoad NameLoad attr Assign SubscriptStore AttributeLoad NameLoad attr Index AttributeLoad AttributeLoad NameLoad attr attr TupleLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad ListLoad AttributeLoad NameLoad attr keyword NameLoad handlers ExceptHandler type NameLoad name NameStore body Import alias Assign NameStore Call AttributeLoad NameLoad attr Expr Call NameLoad NameLoad NameLoad AttributeLoad NameLoad attr NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Call NameLoad NameLoad NameLoad AttributeLoad NameLoad attr If CompareIn AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults NameLoad body For TupleStore NameStore NameStore AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr For TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr body Expr Call AttributeLoad NameLoad attr For NameStore AttributeLoad NameLoad attr body TryExcept body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad handlers ExceptHandler body Pass Assign AttributeStore NameLoad attr ListLoad Assign AttributeStore NameLoad attr Dict Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list NameLoad decorator_list FunctionDef arguments args defaults body If CompareEq Call AttributeLoad NameLoad attr Num body Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index Str Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index Str Expr Call AttributeLoad NameLoad attr Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore Call NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr decorator_list If CompareEq NameLoad Str body Expr Call NameLoad
N/A N/A logging N/A os sys time N/A signal N/A os.path N/A marshal N/A cPickle N/A multiprocessing N/A threading N/A SocketServer N/A SimpleHTTPServer N/A shutil N/A socket N/A urllib2 N/A platform N/A gc N/A time N/A zmq N/A pymesos mesos mesos.interface mesos_pb2 mesos.interface Executor N/A N/A N/A N/A sys path insert 0 N/A N/A N/A os path dirname N/A N/A N/A os path dirname __file__ dpark.util compress decompress spawn dpark.serialize marshalable dpark.accumulator Accumulator dpark.schedule Success FetchFailed OtherFailure dpark.env env dpark.shuffle LocalFileShuffle dpark.mutable_dict MutableDict dpark.serialize loads N/A logger N/A N/A logging getLogger N/A dpark.executor@%s N/A N/A socket gethostname N/A TASK_RESULT_LIMIT N/A 1024 256 N/A DEFAULT_WEB_PORT 5055 N/A MAX_WORKER_IDLE_TIME 60 N/A MAX_EXECUTOR_IDLE_TIME N/A N/A 60 60 24 N/A Script setproctitle N/A N/A x N/A N/A N/A N/A setproctitle setproctitle _setproctitle N/A N/A _setproctitle x N/A N/A N/A ImportError N/A N/A N/A reply_status N/A N/A driver task_id state data N/A None N/A N/A status N/A N/A mesos_pb2 TaskStatus N/A N/A N/A N/A status task_id MergeFrom task_id N/A N/A status state state N/A N/A status timestamp N/A N/A time time N/A N/A data None N/A N/A N/A status data data N/A N/A N/A driver sendStatusUpdate status N/A run_task N/A N/A task_data N/A N/A N/A N/A N/A N/A N/A N/A N/A gc disable N/A N/A task ntry N/A loads N/A decompress task_data N/A N/A N/A Accumulator clear N/A result N/A N/A task run ntry N/A accUpdate N/A N/A Accumulator values N/A N/A N/A MutableDict flush N/A N/A marshalable result N/A N/A N/A N/A N/A flag data N/A 0 N/A N/A marshal dumps result N/A N/A N/A Exception N/A e N/A N/A N/A flag data N/A 1 N/A N/A cPickle dumps result -1 N/A N/A N/A flag data N/A 1 N/A N/A cPickle dumps result -1 N/A data N/A compress data N/A N/A N/A len data TASK_RESULT_LIMIT N/A N/A path N/A N/A LocalFileShuffle getOutputFile 0 ntry N/A task id N/A len data N/A f N/A open path w N/A N/A N/A f write data N/A N/A N/A f close N/A data N/A N/A / join N/A N/A N/A N/A LocalFileShuffle getServerUri N/A N/A N/A path split / N/A -3 N/A flag 2 N/A N/A N/A mesos_pb2 TASK_FINISHED N/A N/A cPickle dumps N/A N/A Success N/A flag data accUpdate -1 N/A N/A N/A FetchFailed N/A e N/A N/A N/A N/A mesos_pb2 TASK_FAILED N/A N/A cPickle dumps N/A e None None -1 N/A N/A N/A traceback N/A msg N/A N/A traceback format_exc N/A N/A N/A mesos_pb2 TASK_FAILED N/A N/A cPickle dumps N/A N/A OtherFailure msg None None -1 N/A N/A N/A N/A gc collect N/A N/A N/A gc enable N/A init_env N/A N/A args N/A N/A N/A N/A N/A env start False args N/A LocalizedHTTP N/A N/A SimpleHTTPServer SimpleHTTPRequestHandler N/A N/A basedir None translate_path N/A N/A self path N/A N/A N/A out N/A N/A N/A SimpleHTTPServer SimpleHTTPRequestHandler translate_path self path N/A N/A N/A N/A self basedir / N/A N/A N/A os path relpath out N/A log_message N/A N/A self format N/A args N/A N/A N/A N/A startWebServer N/A N/A path N/A N/A N/A N/A N/A N/A N/A os path exists path N/A N/A N/A N/A os makedirs path N/A testpath N/A N/A N/A os path join path test N/A N/A open testpath w f N/A N/A N/A N/A f write path N/A default_uri N/A http://%s:%d/%s N/A N/A N/A socket gethostname DEFAULT_WEB_PORT N/A N/A N/A os path basename path N/A N/A N/A data N/A N/A N/A N/A urllib2 urlopen N/A N/A default_uri / test read N/A N/A data path N/A N/A default_uri N/A N/A N/A IOError N/A e N/A N/A N/A N/A N/A logger warning default webserver at %s not available DEFAULT_WEB_PORT N/A N/A LocalizedHTTP basedir N/A N/A N/A os path dirname path N/A ss N/A N/A SocketServer TCPServer N/A 0.0.0.0 0 LocalizedHTTP N/A N/A spawn N/A ss serve_forever N/A uri N/A http://%s:%d/%s N/A N/A N/A socket gethostname N/A N/A ss server_address N/A 1 N/A N/A N/A os path basename path N/A uri N/A forward N/A N/A fd addr prefix N/A N/A N/A f N/A N/A os fdopen fd r N/A ctx N/A N/A zmq Context N/A out N/A None N/A buf N/A send N/A N/A buf N/A N/A N/A N/A N/A out N/A 0 N/A N/A N/A out N/A 0 N/A N/A ctx socket N/A zmq PUSH N/A N/A N/A N/A out N/A 0 connect addr N/A N/A N/A N/A out N/A 0 send N/A prefix N/A N/A join buf N/A N/A True N/A N/A N/A N/A line N/A N/A f readline N/A N/A line N/A N/A N/A N/A N/A buf append line N/A N/A N/A line endswith N/A N/A N/A send buf N/A buf N/A N/A N/A N/A IOError N/A N/A N/A buf N/A N/A N/A send buf N/A N/A out N/A 0 N/A N/A N/A N/A N/A out N/A 0 close N/A N/A N/A f close N/A N/A N/A ctx shutdown N/A get_pool_memory N/A N/A pool N/A N/A N/A N/A N/A psutil N/A p N/A N/A psutil Process N/A N/A N/A pool _pool N/A 0 pid N/A N/A N/A N/A N/A p memory_info rss 20 N/A N/A N/A Exception N/A N/A 0 N/A get_task_memory N/A N/A task N/A N/A N/A r N/A task resources N/A N/A N/A N/A r name mem N/A N/A N/A N/A r scalar value N/A N/A N/A logger error no memory in resource: %s N/A task resources N/A 100 N/A safe N/A N/A f N/A N/A _ N/A N/A self N/A a kw N/A N/A N/A self lock N/A N/A r N/A f self a kw N/A r N/A N/A _ N/A setup_cleaner_process N/A N/A workdir N/A N/A N/A ppid N/A N/A os getpid N/A pid N/A N/A os fork N/A N/A pid 0 N/A N/A N/A N/A os setsid N/A pid N/A N/A os fork N/A N/A pid 0 N/A N/A N/A N/A psutil N/A N/A N/A ImportError N/A N/A N/A N/A os _exit 1 N/A N/A N/A N/A N/A N/A N/A N/A N/A psutil Process ppid wait N/A N/A N/A os killpg ppid N/A signal SIGKILL N/A N/A N/A Exception N/A e N/A N/A N/A N/A d workdir N/A N/A N/A N/A N/A os path exists d N/A N/A N/A N/A N/A N/A shutil rmtree d True N/A N/A N/A N/A N/A N/A N/A os _exit 0 N/A N/A N/A os wait N/A MyExecutor N/A Executor N/A __init__ N/A N/A self N/A N/A N/A N/A self workdir N/A N/A N/A self idle_workers N/A N/A N/A self busy_workers N/A N/A N/A self lock N/A N/A threading RLock N/A N/A N/A self stdout wfd N/A N/A os pipe N/A N/A sys stdout N/A N/A os fdopen wfd w 0 N/A N/A N/A os close 1 N/A N/A N/A N/A os dup wfd 1 redirect io failed N/A N/A N/A self stderr wfd N/A N/A os pipe N/A N/A sys stderr N/A N/A os fdopen wfd w 0 N/A N/A N/A os close 2 N/A N/A N/A N/A os dup wfd 2 redirect io failed N/A check_memory N/A N/A self driver N/A N/A N/A N/A N/A psutil N/A N/A N/A ImportError N/A N/A N/A N/A logger error no psutil module N/A N/A mem_limit N/A N/A idle_since N/A N/A time time N/A True N/A N/A N/A N/A N/A self lock acquire N/A N/A tid N/A task pool N/A N/A N/A self busy_workers items N/A N/A task_id N/A task task_id N/A N/A N/A pid N/A N/A N/A pool _pool N/A 0 pid N/A p N/A N/A psutil Process pid N/A rss N/A N/A N/A N/A p memory_info rss 20 N/A N/A N/A Exception N/A e N/A N/A N/A N/A logger error worker process %d of task %s is dead: %s pid tid e N/A N/A reply_status driver task_id N/A mesos_pb2 TASK_LOST N/A N/A N/A N/A self busy_workers pop tid N/A N/A N/A N/A N/A p status N/A psutil STATUS_ZOMBIE N/A N/A N/A p is_running N/A N/A N/A N/A logger error worker process %d of task %s is zombie pid tid N/A N/A reply_status driver task_id N/A mesos_pb2 TASK_LOST N/A N/A N/A N/A self busy_workers pop tid N/A N/A offered N/A get_task_memory task N/A N/A offered N/A N/A N/A N/A rss N/A offered 1.5 N/A N/A N/A N/A logger warning N/A task %s used too much memory: %dMB > %dMB * 1.5, kill it.  use -M argument or taskMemory to request more memory. tid rss offered N/A N/A reply_status driver task_id N/A mesos_pb2 TASK_KILLED N/A N/A N/A N/A self busy_workers pop tid N/A N/A N/A pool terminate N/A N/A N/A rss N/A offered N/A N/A mem_limit get tid 1.0 N/A N/A N/A N/A logger debug N/A task %s used too much memory: %dMB > %dMB,  use -M to request or taskMemory for more memory tid rss offered N/A N/A mem_limit N/A tid N/A N/A rss offered 0.1 N/A now N/A N/A time time N/A n N/A len N/A 1 N/A N/A t p N/A self idle_workers N/A N/A t MAX_WORKER_IDLE_TIME now N/A n N/A N/A N/A _ p N/A N/A self idle_workers N/A n N/A N/A N/A N/A p terminate N/A N/A self idle_workers N/A N/A self idle_workers N/A n N/A N/A N/A self busy_workers N/A self idle_workers N/A N/A idle_since now N/A N/A N/A N/A idle_since MAX_EXECUTOR_IDLE_TIME now N/A N/A N/A N/A os _exit 0 N/A N/A N/A N/A self lock release N/A N/A N/A time sleep 1 N/A registered N/A N/A self driver executorInfo frameworkInfo slaveInfo N/A N/A N/A N/A N/A Script N/A N/A Script cwd python_path osenv N/A self parallel out_logger err_logger logLevel args N/A N/A marshal loads N/A executorInfo data N/A N/A self init_args args N/A N/A sys path python_path N/A N/A N/A N/A os environ update osenv N/A N/A setproctitle Script N/A prefix N/A [%s]  N/A N/A socket gethostname N/A N/A self outt N/A spawn forward N/A self stdout out_logger prefix N/A N/A self errt N/A spawn forward N/A self stderr err_logger prefix N/A N/A N/A logging basicConfig format %(asctime)-15s [%(levelname)s] [%(name)-9s] %(message)s level logLevel N/A N/A N/A N/A os path exists cwd N/A N/A N/A N/A N/A N/A os chdir cwd N/A N/A N/A Exception N/A e N/A N/A N/A N/A logger warning change cwd to %s failed: %s cwd e N/A N/A N/A N/A logger warning cwd (%s) not exists cwd N/A N/A self workdir N/A args N/A WORKDIR N/A root N/A N/A N/A os path dirname N/A N/A self workdir N/A 0 N/A N/A N/A N/A N/A os path exists root N/A N/A N/A N/A os mkdir root N/A N/A N/A os chmod root 511 N/A N/A args N/A SERVER_URI N/A startWebServer N/A N/A self workdir N/A 0 N/A N/A MESOS_SLAVE_PID N/A os environ N/A N/A N/A setup_cleaner_process N/A self workdir N/A N/A spawn N/A self check_memory driver N/A N/A N/A logger debug executor started at %s N/A slaveInfo hostname N/A N/A N/A Exception N/A e N/A N/A traceback N/A msg N/A N/A traceback format_exc N/A N/A N/A logger error init executor failed: %s msg N/A N/A safe get_idle_worker N/A N/A self N/A N/A N/A N/A N/A N/A N/A N/A N/A self idle_workers pop N/A 1 N/A N/A N/A IndexError N/A N/A p N/A N/A multiprocessing Pool 1 init_env N/A N/A self init_args N/A N/A p done 0 N/A p N/A launchTask N/A N/A self driver task N/A N/A N/A task_id N/A task task_id N/A N/A reply_status driver task_id N/A mesos_pb2 TASK_RUNNING N/A N/A N/A logger debug launch task %s N/A N/A task task_id value N/A N/A callback N/A N/A N/A state data N/A N/A N/A N/A reply_status driver task_id state data N/A N/A self lock N/A N/A N/A _ pool N/A N/A N/A self busy_workers pop N/A N/A task task_id value N/A N/A pool done 1 N/A N/A N/A N/A self idle_workers append N/A N/A N/A time time pool N/A N/A pool N/A N/A self get_idle_worker N/A N/A N/A self busy_workers N/A N/A N/A task task_id value N/A task pool N/A N/A N/A pool apply_async run_task N/A N/A task data callback callback N/A N/A N/A Exception N/A e N/A N/A traceback N/A msg N/A N/A traceback format_exc N/A N/A reply_status driver task_id N/A mesos_pb2 TASK_LOST msg N/A safe killTask N/A N/A self driver taskId N/A N/A N/A N/A reply_status driver taskId N/A mesos_pb2 TASK_KILLED N/A N/A N/A taskId value N/A self busy_workers N/A N/A N/A task pool N/A N/A N/A self busy_workers pop N/A taskId value N/A N/A N/A pool terminate N/A safe shutdown N/A N/A self driver N/A None N/A N/A N/A _ p N/A self idle_workers N/A N/A N/A N/A p terminate N/A N/A _ p N/A N/A N/A self busy_workers itervalues N/A N/A N/A N/A p terminate N/A d N/A self workdir N/A N/A N/A N/A N/A N/A shutil rmtree d True N/A N/A N/A N/A N/A N/A self idle_workers N/A N/A N/A self busy_workers N/A N/A N/A N/A N/A sys stdout close N/A N/A N/A N/A sys stderr close N/A N/A N/A os close 1 N/A N/A N/A os close 2 N/A N/A N/A N/A self outt join N/A N/A N/A N/A self errt join N/A safe N/A run N/A N/A N/A N/A N/A N/A N/A N/A os getuid 0 N/A N/A gid N/A N/A os environ N/A GID N/A uid N/A N/A os environ N/A UID N/A N/A N/A os setgid N/A int gid N/A N/A N/A os setuid N/A int uid N/A executor N/A MyExecutor N/A driver N/A N/A mesos MesosExecutorDriver executor N/A N/A N/A driver run N/A N/A N/A __name__ __main__ N/A N/A N/A run