Patent ID: 8346736
Filing Date: 2013-01-01
Classification: G06F

Abstract:
1. A method to deduplicate data, comprising: receiving a data set; setting a data chunk size equal to a length of a data track written to a data storage medium; selecting a data chunk, wherein said data chunk comprises all or a portion of said data set; selecting a first stage deduplication algorithm that generates a Digest comprising 128 bits; selecting a second stage deduplication algorithm, that generates a Digest comprising 256 or 512 bits; performing a first stage deduplication analysis of said data chunk using said first stage deduplication algorithm; operative if said first stage deduplication analysis finds duplicate data, performing a second state deduplication analysis of said data chunk using said second stage deduplication algorithm, wherein said first stage deduplication algorithm utilizes 3.66 cycles per byte of data; and wherein said second stage deduplication algorithm utilizes 20.59 or 40.18 cycles per byte of data.