Adding pluggablility to work allocation, along with a new work allocation strategy to group small topics partitions within the same task.

The purpose of the new work allocation is to reduce the overall output file count.  Also included in this request is some optimizations for the daily sweeper code.
I believe it is, but we do need to do some cleanup refactoring on this.  For now, I'm just moving partitioners to their own package.