Patent ID: 9628299
Date: 2017-04-18
CPC Classifications: G06F,H04L

Claim:
1. A method for data migration between data generating entities and a File System, comprising: (a) operatively coupling a Burst Buffer (BB) tier between at least one data generating entity and a File System, and configuring said BB tier with a plurality of Burst Buffer (BB) nodes, each operating with data input speed exceeding the data input speed of said File System; (b) configuring said File System with at least one Burst Buffer Network Aggregator (BBNA) unit; (c) sending a first data write request from said at least one data generating entity to said BB tier, said first data write request including a plurality of data fragments related to a respective data stripe; (d) distributing said first data write request into said plurality of data fragments, and storing each of said plurality of data fragments and metadata associated therewith in a respective participating BB node from said plurality of BB nodes in said BB tier; (e) assigning a primary BB node from said participating BB nodes for servicing said first data write request; (f) gathering, by said primary BB node, metadata for said plurality of data fragments residing in said participating BB nodes, and generating a metadata list corresponding to said plurality of data fragments for said respective data stripe; (g) sending a command to coalesce said plurality of data fragments for said respective data stripe along with said metadata list from said primary BB node to said at least one BBNA unit; (h) subsequently, allocating, by said at least one BBNA unit, a full data stripe buffer sufficient to accommodate said first data write request; (i) transferring said plurality of data fragments from said participating BB nodes into said full data stripe buffer in accordance with said metadata list, thereby coalescing said plurality of data fragments of said data write request into a full said respective data stripe in said full data stripe buffer; and (j) transferring said full data stripe from said full data stripe buffer of said at least one BBNA unit into said File System.