Patent ID: 9405592
Filing Date: 2016-08-02
CPC Classification: G06F

Claim Text:
1. A method, comprising: identifying, by a workload balancer executing on at least one processor in a map reduce system, a partition total for partitions of data; assigning, by the workload balancer, one or more of the partitions to one of a plurality of reducers by processing a cost analysis that assigns a cost estimate for that reducer when processing a proposed assignment of the one or more partitions in addition to existing partitions already assigned to that reducer; identifying, by the workload balancer, a data skew and data size for data in the existing partitions and in the proposed assigned one or more partitions for assigning the cost estimate; and maintaining, by the workload balancer, at least one partition that remains unassigned to any of the reducers in an unassigned partition pool.