Patent ID: 8688652
Filing Date: 2014-04-01
Classification: G06F

Abstract:
1. A method for increased in-line deduplication efficiency by a processor device in a computing environment, the method comprising: calculating in nth iterations hash values on data samples from fixed size data chunks extracted from an object requested for in-line deduplication; for each of the nth iterations, matching in a nth hash index table the calculated hash values for the data samples from the fixed size data chunks with a corresponding hash value of existing objects in storage, wherein the nth hash index table is built for each of the data samples belonging to the fixed data chunks; exiting the nth hash index table upon detecting a mismatch of the calculated hash values for one of the data samples from the fixed size data chunks during the matching, wherein the mismatch is determined to be a unique object and is stored; incrementing the size of the data samples from the fixed size data chunks for each of the nth iterations for reaching the full size of the object; determining a plurality of patterns from historical data for the incrementing based upon a deduplication ratio, wherein the nth iterations decrease as the deduplication ratio increases and the nth iterations increase as the deduplication ratio decreases; and upon completing the extraction of the data samples from the fixed size data chunks in the object and performing the matching without detecting a mismatch in the nth hash index table, calculating a hash value for the object, wherein a master hash index table is updated with the calculated hash value for the object and the calculated hash values for the unique object and performing the matching in a master hash index table for the calculated hash value of the object.