Making work allocation pluggable and adding a new topic grouping allocator that allocates small topics to the same task. This paves the way to add a new Partitioner that writes fewer files.
moving partitioners to new package
cleaning up partition logic and adding a new topic grouping partitioner that will produce fewer files