Yelp/mrjob — Issue #324: pooling: check if there's space for multi-step jobs
Author: davidmarin
Created: 2011-12-29 01:14:39+00:00
State: open
Labels: Bug

The maximum number of steps a job flow can accept is 256. mrjob currently checks to make sure that job flows have no more than 255 steps already, which is correct for one-step jobs, but wrong for multi-step jobs.

(Working on this anyway as part of merging spot instance code from @hblanks with job flow pooling.)