Patent ID: 9703610
Date: 2017-07-11
CPC Classifications: G06F,H04L

Claim:
1. A method for managing storage of a large data set partitioned into a plurality of partitions in a data grid cluster comprising a plurality of computer nodes each comprising a microprocessor and memory, said method comprising: designating one computer node in said data grid cluster to be a distribution coordinator; executing a distribution strategy on said distribution coordinator to generate a distribution plan which identifies, for all of said plurality of partitions, which of said plurality of partitions should be stored on which of said plurality of computer nodes in the data grid cluster; storing said plurality of partitions in said memory of said plurality of computer nodes of the data grid cluster in accordance with said distribution plan; receiving, at the distribution coordinator, runtime feedback from each of the plurality of computer nodes in the data grid cluster; analyzing, by the distribution coordinator, a global state of the data grid cluster, which comprises said distribution plan and said runtime feedback, in order to determine whether changes should be made to the distribution plan; executing the distribution strategy on said distribution coordinator, using said global sate of the data grid cluster, to generate a new distribution plan which identifies, for all of said plurality of partitions, which of said plurality of partitions should be stored on which of said plurality of computer nodes in the data grid cluster; accessing the new distribution plan from each of said plurality of computer nodes in the data grid cluster; analyzing the new distribution plan in each computer node in the data grid cluster to determine whether the new distribution plan specifies changes to which partitions which should be stored in memory of said each node, and if so then one or both of wherein the plurality of partitions comprises a plurality of primary partitions and a plurality of backup partitions wherein each primary partition of the plurality of primary partitions is associated with a backup partition of the plurality of backup partitions, and wherein the distribution plan and new distribution plan generated by the distribution coordinator ensure that each primary partition of the plurality of primary partitions is located on a different computer node than the backup partition associated with said each primary partition.