NICTA/scoobi — Issue #27: provide a way to control the number of reducers
Author: xelax
Created: 2011-12-22 02:33:18+00:00
State: open

In large map-reduce jobs is useful to tweak the number reducers used, either to control the number of split files produced or to ensure that enough reducers are available to complete the step efficiently.
Even better would be that the optimizer figures out automatically the optimal number, but providing a hint to the optimizer is a good short-term solution.