Patent ID: 11954118
Assignee: EMC IP HOLDING COMPANY LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. A method of backing up data, comprising:
in response to receiving from a backup server a data stream to be backed up, dividing, by a management node, the data stream into a plurality of data segments;
distributing, by the management node, the plurality of data segments to at least one computing node, the management node being different from each computing node,
wherein distributing the plurality of data segments to the at least one computing node comprises:
increasing a probability of deduplication of the plurality of data segments based on a pre-binding of the backup server to a first computing node from among the at least one computing node;
determining, from the at least one computing node, the pre-binding of the backup server to the first computing node; and
distributing the plurality of data segments to the first computing node,

wherein in response to distributing the plurality of data segments to the first computing node, a primary deduplication task is performed by the first computing node, and
wherein during performance of the primary deduplication task by the first computing node, a hash uniquely identifying a respective data segment from among the plurality of data segments is calculated, the hash is looked up in a local hash cache of the first computing node, and in response to the hash being missed in the local hash cache, the hash is sent to the management node;
in response to receiving the hash of the respective data segment at the management node from the first computing node, performing a secondary deduplication task by the management node, the secondary deduplication task performed by the management node comprising:
looking up the hash in a global hash cache of the management node, the global hash cache storing hashes of data in a backup storage device,

wherein looking up the hash includes accessing the global hash cache from the management node; and
in response to missing the hash in the global hash cache of the management node, adding the hash into the global hash cache, and sending to the first computing node an indication to store the respective data segment in the backup storage device.