Yelp/mrjob — Issue #387: in AWS EMR:  submit a job directly to the JobTracker of the hadoop cluster created by a jobflow?
Author: tokarina
Created: 2012-03-07 02:59:54+00:00
State: open

Based on #385

Is there a way to submit a job directly to the JobTracker of the hadoop cluster created by a jobflow?

I bet there is a way to do this now -- albeit probably without the typical ease of use in other mrjob actions :-)

This would allow running of multiple concurrent jobs, which appears to be impossible through the EMR Job Flow interface, because it is a sequence of one-job-sized steps. Or perhaps there is another way to take advantage of the Fair Scheduler in AWS EMR?