Module Import alias Import alias Import alias ImportFrom alias alias alias ImportFrom alias ImportFrom alias ImportFrom alias Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Str Assign NameStore Str Assign NameStore Str Assign NameStore Str Assign NameStore Str Assign NameStore Str ClassDef bases NameLoad body FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Dict Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr BinOpMod Str AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr BinOpMod Str Call NameLoad NameLoad For NameStore NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr BinOpMod Str NameLoad TryExcept body Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr Str Raise decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore ListLoad Expr Call AttributeLoad NameLoad attr BinOpMod Str AttributeLoad AttributeLoad NameLoad attr attr TryExcept body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr Str Return NameLoad Assign NameStore AttributeLoad NameLoad attr AugAssignAdd AttributeStore NameLoad attr Num Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr Call NameLoad NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr BinOpMod Str NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr Str Assign AttributeStore NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore AttributeLoad NameLoad attr attr Num Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr Str Assign AttributeStore NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore AttributeLoad NameLoad attr attr Num Expr Call AttributeLoad NameLoad attr NameLoad Assign SubscriptStore AttributeLoad NameLoad attr Index AttributeLoad AttributeLoad NameLoad attr attr TupleLoad AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr BinOpMod Str Call AttributeLoad NameLoad attr If CompareEq AttributeLoad NameLoad attr AttributeLoad NameLoad attr body AugAssignAdd AttributeStore NameLoad attr Num Assign TupleStore NameStore NameStore SubscriptLoad AttributeLoad NameLoad attr Index AttributeLoad AttributeLoad NameLoad attr attr AugAssignAdd AttributeStore NameLoad attr Num Expr Call AttributeLoad NameLoad attr NameLoad NameLoad Str decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults body AugAssignAdd AttributeStore NameLoad attr Num Expr Call AttributeLoad NameLoad attr Str Call NameLoad Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body TryFinally body Expr Call AttributeLoad NameLoad attr NameLoad finalbody Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body If CompareNotIn Str NameLoad body Assign SubscriptStore NameLoad Index Str ListLoad Expr Call AttributeLoad SubscriptLoad NameLoad Index Str attr Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad keyword NameLoad keyword AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return ListLoad Call NameLoad keyword Str keyword AttributeLoad NameLoad attr decorator_list decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr NameLoad Assign AttributeStore AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Str Str Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign NameStore Call NameLoad NameLoad keyword NameLoad keyword NameLoad Assign NameStore Call NameLoad NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword SubscriptLoad NameLoad Index Str keyword NameLoad FunctionDef arguments args defaults body Expr Call AttributeLoad NameLoad attr Str keyword AttributeLoad NameLoad attr keyword NameLoad decorator_list Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad NameLoad TryFinally body TryExcept body Expr Call AttributeLoad NameLoad attr Str If CompareNotEq Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Raise Call NameLoad Str handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr Str Raise finalbody Expr Call AttributeLoad NameLoad attr decorator_list
N/A N/A collections N/A logging N/A os pulsar.mesos Scheduler MesosSchedulerDriver mesos_pb2 pulsar.client.util to_base64_json pulsar.main PULSAR_ROOT_DIR pulsar.messaging bind_amqp N/A log N/A N/A logging getLogger __name__ N/A DEFAULT_FRAMEWORK_USER N/A DEFAULT_FRAMEWORK_NAME Pulsar Framework N/A DEFAULT_FRAMEWORK_PRINCIPAL Pulsar N/A DEFAULT_EXECUTOR_ID default N/A DEFAULT_EXECUTOR_NAME Pulsar Executor N/A DEFAULT_EXECUTOR_SOURCE Pulsar PulsarScheduler N/A Scheduler N/A __init__ N/A N/A self executor manager_options mesos_url N/A N/A N/A N/A self executor executor N/A N/A self manager_options manager_options N/A N/A self mesos_url mesos_url N/A N/A self taskData N/A N/A N/A self tasksLaunched 0 N/A N/A self tasksFinished 0 N/A N/A self messagesSent 0 N/A N/A self messagesReceived 0 N/A N/A self in_memory_queue N/A N/A collections deque N/A registered N/A N/A self driver frameworkId masterInfo N/A N/A N/A N/A N/A log info N/A Registered with Pulsar mesos framework ID %s N/A frameworkId value N/A resourceOffers N/A N/A self driver offers N/A N/A N/A N/A N/A log info N/A Got %d resource offers N/A len offers N/A offer offers N/A N/A tasks N/A N/A self _tasks_for_offer offer N/A tasks N/A N/A N/A N/A log info N/A Launching tasks %s tasks N/A N/A N/A N/A N/A driver launchTasks N/A offer id tasks N/A N/A N/A Exception N/A N/A N/A N/A log exception Failed to launch tasks N/A N/A _tasks_for_offer N/A N/A self offer N/A N/A N/A tasks N/A N/A N/A N/A log info N/A Got resource offer %s N/A N/A offer id value N/A N/A N/A next_job N/A N/A N/A self in_memory_queue pop N/A N/A N/A IndexError N/A N/A N/A N/A log info No jobs, skipping iteration N/A tasks N/A tid N/A self tasksLaunched N/A N/A self tasksLaunched 1 N/A N/A N/A log info N/A Accepting offer on %s to start task %d N/A N/A offer hostname tid N/A task N/A N/A mesos_pb2 TaskInfo N/A N/A N/A task task_id value N/A str tid N/A N/A N/A task slave_id value N/A N/A offer slave_id value N/A N/A task name N/A task %d tid N/A N/A N/A N/A task executor MergeFrom N/A self executor N/A N/A N/A self _populate_task_data_for_job task next_job N/A cpus N/A N/A N/A task resources add N/A N/A cpus name cpus N/A N/A cpus type N/A N/A mesos_pb2 Value SCALAR N/A N/A N/A cpus scalar value 1 N/A mem N/A N/A N/A task resources add N/A N/A mem name mem N/A N/A mem type N/A N/A mesos_pb2 Value SCALAR N/A N/A N/A mem scalar value 32 N/A N/A N/A tasks append task N/A N/A N/A self taskData N/A N/A N/A task task_id value N/A N/A offer slave_id N/A N/A task executor executor_id N/A tasks N/A statusUpdate N/A N/A self driver update N/A N/A N/A N/A N/A log info N/A %s N/A N/A update SerializeToString N/A N/A N/A update state N/A mesos_pb2 TASK_FINISHED N/A N/A N/A self tasksFinished 1 N/A N/A slave_id executor_id N/A N/A self taskData N/A N/A N/A update task_id value N/A N/A self messagesSent 1 N/A N/A N/A driver sendFrameworkMessage executor_id slave_id Update N/A frameworkMessage N/A N/A self driver executorId slaveId message N/A N/A N/A N/A self messagesReceived 1 N/A N/A N/A log info Received message: %s N/A repr N/A str message N/A handle_setup_message N/A N/A self body message N/A N/A N/A N/A N/A N/A N/A self __queue_setup_message body N/A N/A N/A N/A message ack N/A _populate_task_data_for_job N/A N/A self task job N/A N/A N/A N/A env job N/A N/A N/A job N/A env N/A N/A N/A N/A N/A job N/A env extend N/A N/A self _mesos_env_vars N/A task_data N/A dict job job manager N/A self manager_options N/A N/A task data N/A to_base64_json task_data N/A __queue_setup_message N/A N/A self body N/A N/A N/A N/A N/A N/A self in_memory_queue appendleft body N/A _mesos_env_vars N/A N/A self N/A N/A N/A N/A N/A dict name MESOS_URL value N/A self mesos_url N/A N/A run N/A N/A master manager_options config N/A N/A N/A executor N/A N/A mesos_pb2 ExecutorInfo N/A N/A N/A executor executor_id value DEFAULT_EXECUTOR_ID N/A N/A N/A executor command value N/A N/A N/A os path join PULSAR_ROOT_DIR scripts mesos_executor N/A N/A executor name DEFAULT_EXECUTOR_NAME N/A N/A executor source DEFAULT_EXECUTOR_SOURCE N/A framework N/A N/A mesos_pb2 FrameworkInfo N/A N/A framework user DEFAULT_FRAMEWORK_USER N/A N/A framework name DEFAULT_FRAMEWORK_NAME N/A N/A framework principal DEFAULT_FRAMEWORK_PRINCIPAL N/A scheduler N/A PulsarScheduler executor manager_options manager_options mesos_url master N/A driver N/A MesosSchedulerDriver scheduler framework master N/A message_queue_url N/A N/A config get message_queue_url None N/A exchange N/A N/A bind_amqp get_exchange message_queue_url manager_name N/A manager_options N/A manager conf config drain N/A N/A N/A N/A N/A N/A N/A exchange consume setup callback N/A scheduler handle_setup_message check True N/A N/A N/A N/A log info Binding to Pulsar framework to queue. N/A N/A N/A bind_amqp start_setup_consumer exchange drain N/A N/A N/A N/A N/A N/A N/A log info Starting Mesos driver N/A N/A N/A N/A driver run N/A mesos_pb2 DRIVER_STOPPED N/A N/A N/A Exception Driver did not run properly N/A N/A N/A Exception N/A N/A N/A N/A log exception Problem running mesos scheduler N/A N/A N/A N/A N/A driver stop N/A