Patent ID: 9485197
Filing Date: 2016-11-01
CPC Classification: H04L

Claim Text:
1. A method comprising: receiving, at a device, information regarding a data set to be processed by a map-reduce process, wherein the map-reduce process comprises a rack-aware scheduler; generating a set of virtual clusters for the map-reduce process based on network bandwidths between nodes of the virtual clusters, each node of a virtual cluster corresponding to a resource device, wherein the set of virtual clusters are generated such that intra-cluster bandwidths in the set are greater than inter-cluster bandwidths in the set; associating the data set with a map-reduce process task; and scheduling, by the rack-aware scheduler, the execution of the task by a node of the virtual clusters based on the network bandwidth between the node and a source node on which the data set resides, wherein the virtual clusters are used by the rack-aware scheduler in lieu of a physical rack to make scheduling decisions.