Patent ID: 8140491
Filing Date: 2012-03-20
Classification: G06F

Abstract:
1. A method for adaptive deduplication of stored data objects, comprising: retrieving a first portion of a plurality of stored objects from at least one storage device; performing a base type deduplication estimation process on the first portion of stored objects, resulting in an estimation of a first plurality of deduplication chunk portions of the first portion of stored objects; categorizing the first portion of the plurality of stored objects into deduplication sets based on a deduplication relationship of each object of the plurality of stored objects with each of the estimated first plurality of deduplication chunk portions; combining deduplication sets into one or more broad classes based on deduplication characteristics of the objects in the deduplication sets; building classifiers for each one or more broad classes using metadata attributes and content attributes of each object of the first portion of the plurality of stored objects and classifying a second portion of the plurality of stored objects into one or more broad classes using the classifiers; and selecting an appropriate deduplication approach for each categorized class and using a chunk portion size threshold for narrowing down a chunk size for a Variable Chunk Size Hashing class.