Yelp/mrjob — Issue #301: Running with inline runner creates additional step.
Author: slnovak
Created: 2011-11-30 18:45:30+00:00
State: open

Running with the latest dev branch (r5a9868). If I try running with the inline runner, I get the error `ValueError: Out-of-range step: 4` (mrjob/job.py, line 587). Running with local runner, my code runs as expected.

Here is my steps definition. Note that self.options.iteration_count=2, creating a four-step MR workflow.

```python
def steps(self):
return [self.mr(mapper=self.parse_input,
combiner=self.combine_inputs,
reducer_init=self.prepare_word_collection,
reducer=self.collect_word_counts,
reducer_final=self.build_corpus_matrix)] + \
[self.mr(mapper_init=self.prepare_gibbs_iteration,
mapper=self.iterate_gibbs,
mapper_final=self.consolidate_gibbs_iteration,
reducer_init=self.prepare_for_consolidation,
reducer=self.update_word_count_distributions,
reducer_final=self.update_words_per_topic_matrix)] * self.options.iteration_count + \
[self.mr(reducer_init=self.prepare_for_showing_output,
reducer=self.show_output)]
```

I'll investigate this over the next day or two.