Patent ID: 9703788
Date: 2017-07-11
CPC Classifications: G06F

Claim:
1. A computer-executable method of managing meta-data for a high performance computing (HPC) environment in a distributed storage system, wherein the distributed storage system includes one or more burst buffers enabled to operate with a distributed key-value store and one or more data storage arrays, the computer-executable method comprising: receiving a request for meta-data associated with a block of data stored in a first burst buffer of the one or more burst buffers in the distributed storage system, wherein the meta data is associated with a key-value; determining which of the one or more burst buffers stores the requested metadata; upon determination that a first burst buffer of the one or more burst buffers stores the requested metadata, locating the key-value in a portion of the distributed key-value store accessible from the first burst buffer; communicating between each of the one or more burst buffers to manage the distributed key-value store; moving data between the one or more burst buffers and the one or more data storage arrays, in the distributed storage system, based on a frequency of use of data; wherein the determination enables querying for the metadata in a portion of a total amount of metadata on the distributed key-value store; determining a state of the distributed key-value store; and based on the state, re-balancing the distributed key-value store.