Patent ID: 8285957

Claim:
A method for detecting duplicate data in a data set at a storage server, the method comprising: identifying a first segment in a data set; performing a logical operation on the first segment to convert the first segment into a second segment having a length shorter than the first segment; selecting a number in a range of zero to a specified value inclusive; identifying, if the number is greater than zero, a third segment in the data set adjacent to the first segment, and a fourth segment in the data set adjacent to the third segment, wherein the third segment has a length equal to the number; identifying, if the number is zero, a given segment in the data set adjacent to the first segment as the fourth segment; performing a logical operation on the fourth segment to convert the fourth segment into a fifth segment having a length shorter than the fourth segment; and detecting at the storage server duplicate data in the data set by utilizing the second segment and the fifth segment, wherein the detecting the duplicate data, includes: identifying an anchor in the second segment and the fifth segment; and mapping the anchor into the data set.