Patent ID: 9569457
Date: 2017-02-14
CPC Classifications: G06F

Claim:
1. A data processing method for a distributed system, the distributed system comprising a master storage node and multiple slave storage nodes, the method comprising: storing, responsive to a request for writing a data file, multiple replications of the data file on the multiple slave storage nodes, each of the replications being segmented into data blocks of a same size, wherein the sizes of the segmented data blocks of at least two replications are different; storing distribution information of the multiple replications, wherein the distribution information includes namespace information; periodically obtaining runtime information including a number of available computing units and distribution information of the multiple replications, the computing units being allocable computing resources included in the slave computing nodes; responsive to a request for reading the data file, determining a replication reading strategy based on the runtime information to select one of the multiple replications to read from the multiple replications, wherein the determining a replication reading strategy comprises determining, responsive to a write request for writing a data block of the data file, a placement strategy for the data block, the placement strategy comprising a list of slave storage nodes for placing the data block, the list being a subset of all of the storage nodes of the distributed system; and receiving the data block by any slave storage node in the list of slave storage nodes and communicating the data block to other slave storage nodes by the any slave storage node until a desired number of replications are created.