Module ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam defaults body Expr Str Raise Call NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Raise Call NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Raise Call NameLoad decorator_list decorator_list ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad Str NameLoad body Expr Str Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad If Call NameLoad NameLoad NameLoad body Assign NameStore ListLoad NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore ListLoad If AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return AttributeLoad NameLoad attr decorator_list decorator_list ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad Str NameLoad NameLoad NameLoad NameLoad NameLoad Str body Expr Str Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad If Call NameLoad NameLoad NameLoad body Assign NameStore ListLoad NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore ListLoad If AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr ListLoad Str AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr ListLoad Str AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr ListLoad Str AttributeLoad NameLoad attr orelse Expr Call AttributeLoad NameLoad attr ListLoad Str Str If AttributeLoad NameLoad attr body If Call NameLoad AttributeLoad NameLoad attr NameLoad body For NameStore AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr TupleLoad Str NameLoad orelse Expr Call AttributeLoad NameLoad attr TupleLoad Str AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr TupleLoad Str AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body For NameStore AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr TupleLoad Str NameLoad If AttributeLoad NameLoad attr body For NameStore AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr TupleLoad Str NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return BinOpMod Str TupleLoad AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list decorator_list ClassDef bases NameLoad body Assign NameStore Str FunctionDef arguments args NameParam NameParam defaults kwarg body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad AttributeLoad NameLoad attr NameLoad decorator_list decorator_list ClassDef bases NameLoad body Assign NameStore ListLoad Str Str Str decorator_list ClassDef bases NameLoad body Expr Str Assign NameStore Str FunctionDef arguments args NameParam NameParam defaults Str body Assign NameStore ListLoad Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr ListLoad Str Expr Call AttributeLoad NameLoad attr ListLoad Str NameLoad Expr Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr keyword NameLoad decorator_list decorator_list ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults Str ListLoad body Assign NameStore ListLoad Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr ListLoad Str NameLoad Expr Call AttributeLoad NameLoad attr ListLoad Str Str Str NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad NameLoad keyword NameLoad decorator_list decorator_list
N/A Step N/A object N/A N/A 
    Jobflow Step base class
     jar N/A N/A self N/A N/A N/A 
        :rtype: str
        :return: URI to the jar
         N/A N/A NotImplemented N/A args N/A N/A self N/A N/A N/A 
        :rtype: list(str)
        :return: List of arguments for the step
         N/A N/A NotImplemented N/A main_class N/A N/A self N/A N/A N/A 
        :rtype: str
        :return: The main class name
         N/A N/A NotImplemented N/A N/A JarStep N/A Step N/A N/A 
    Custom jar step
     __init__ N/A N/A self name jar main_class action_on_failure step_args N/A None TERMINATE_JOB_FLOW None N/A N/A 
        A elastic mapreduce step that executes a jar

        :type name: str
        :param name: The name of the step
        :type jar: str
        :param jar: S3 URI to the Jar file
        :type main_class: str
        :param main_class: The class to execute in the jar
        :type action_on_failure: str
        :param action_on_failure: An action, defined in the EMR docs to take on failure.
        :type step_args: list(str)
        :param step_args: A list of arguments to pass to the step
         N/A N/A self name name N/A N/A self _jar jar N/A N/A self _main_class main_class N/A N/A self action_on_failure action_on_failure N/A N/A isinstance step_args basestring N/A N/A step_args N/A step_args N/A N/A self step_args step_args N/A jar N/A N/A self N/A N/A N/A N/A self _jar N/A args N/A N/A self N/A N/A N/A args N/A N/A N/A self step_args N/A N/A N/A N/A args extend N/A self step_args N/A args N/A main_class N/A N/A self N/A N/A N/A N/A self _main_class N/A N/A StreamingStep N/A Step N/A N/A 
    Hadoop streaming step
     __init__ N/A N/A self name mapper reducer combiner action_on_failure cache_files cache_archives step_args input output jar N/A None None TERMINATE_JOB_FLOW None None None None None /home/hadoop/contrib/streaming/hadoop-streaming.jar N/A N/A 
        A hadoop streaming elastic mapreduce step

        :type name: str
        :param name: The name of the step
        :type mapper: str
        :param mapper: The mapper URI
        :type reducer: str
        :param reducer: The reducer URI
        :type combiner: str
        :param combiner: The combiner URI. Only works for Hadoop 0.20 and later!
        :type action_on_failure: str
        :param action_on_failure: An action, defined in the EMR docs to take on failure.
        :type cache_files: list(str)
        :param cache_files: A list of cache files to be bundled with the job
        :type cache_archives: list(str)
        :param cache_archives: A list of jar archives to be bundled with the job
        :type step_args: list(str)
        :param step_args: A list of arguments to pass to the step
        :type input: str or a list of str
        :param input: The input uri
        :type output: str
        :param output: The output uri
        :type jar: str
        :param jar: The hadoop streaming jar. This can be either a local path on the master node, or an s3:// URI.
         N/A N/A self name name N/A N/A self mapper mapper N/A N/A self reducer reducer N/A N/A self combiner combiner N/A N/A self action_on_failure action_on_failure N/A N/A self cache_files cache_files N/A N/A self cache_archives cache_archives N/A N/A self input input N/A N/A self output output N/A N/A self _jar jar N/A N/A isinstance step_args basestring N/A N/A step_args N/A step_args N/A N/A self step_args step_args N/A jar N/A N/A self N/A N/A N/A N/A self _jar N/A main_class N/A N/A self N/A N/A N/A None N/A args N/A N/A self N/A N/A N/A args N/A N/A N/A self step_args N/A N/A N/A N/A args extend N/A self step_args N/A N/A N/A args extend N/A -mapper N/A self mapper N/A N/A self combiner N/A N/A N/A N/A args extend N/A -combiner N/A self combiner N/A N/A self reducer N/A N/A N/A N/A args extend N/A -reducer N/A self reducer N/A N/A N/A N/A args extend N/A -jobconf mapred.reduce.tasks=0 N/A N/A self input N/A N/A N/A isinstance N/A self input list N/A N/A input N/A self input N/A N/A N/A N/A args extend N/A -input input N/A N/A N/A N/A args extend N/A -input N/A self input N/A N/A self output N/A N/A N/A N/A args extend N/A -output N/A self output N/A N/A self cache_files N/A N/A cache_file N/A self cache_files N/A N/A N/A N/A args extend N/A -cacheFile cache_file N/A N/A self cache_archives N/A N/A cache_archive N/A self cache_archives N/A N/A N/A N/A args extend N/A -cacheArchive cache_archive N/A args N/A __repr__ N/A N/A self N/A N/A N/A N/A %s.%s(name=%r, mapper=%r, reducer=%r, action_on_failure=%r, cache_files=%r, cache_archives=%r, step_args=%r, input=%r, output=%r, jar=%r) N/A N/A N/A self __class__ __module__ N/A N/A self __class__ __name__ N/A self name N/A self mapper N/A self reducer N/A self action_on_failure N/A self cache_files N/A self cache_archives N/A self step_args N/A self input N/A self output N/A self _jar N/A N/A ScriptRunnerStep N/A JarStep N/A N/A ScriptRunnerJar s3n://us-east-1.elasticmapreduce/libs/script-runner/script-runner.jar __init__ N/A N/A self name N/A kw N/A N/A N/A N/A JarStep __init__ self name N/A self ScriptRunnerJar kw N/A N/A PigBase N/A ScriptRunnerStep N/A N/A BaseArgs N/A s3n://us-east-1.elasticmapreduce/libs/pig/pig-script --base-path s3n://us-east-1.elasticmapreduce/libs/pig/ N/A InstallPigStep N/A PigBase N/A N/A 
    Install pig on emr step
     N/A InstallPigName Install Pig __init__ N/A N/A self pig_versions N/A latest N/A N/A step_args N/A N/A N/A N/A step_args extend N/A self BaseArgs N/A N/A N/A step_args extend N/A --install-pig N/A N/A N/A step_args extend N/A --pig-versions pig_versions N/A N/A N/A ScriptRunnerStep __init__ self N/A self InstallPigName step_args step_args N/A N/A PigStep N/A PigBase N/A N/A 
    Pig script step
     __init__ N/A N/A self name pig_file pig_versions pig_args N/A latest N/A N/A N/A step_args N/A N/A N/A N/A step_args extend N/A self BaseArgs N/A N/A N/A step_args extend N/A --pig-versions pig_versions N/A N/A N/A step_args extend N/A --run-pig-script --args -f pig_file N/A N/A N/A step_args extend pig_args N/A N/A N/A ScriptRunnerStep __init__ self name step_args step_args N/A N/A