Patent ID: 9690802
Date: 2017-06-27
CPC Classifications: G06F

Claim:
1. A system for processing data, comprising: a storage system module configured to store a plurality of data segments having identifiable segment boundaries, and to receive one or more of a data stream and a data block to be processed for storage; a deduplication module configured to use one or more processors to determine a stream indicated locale, the locale including a selection of a plurality of previously stored data segments satisfying a locality criterion with respect to a portion of the one or more of the data stream and the data block being processed for storage; and a delta compression module configured to use one or more processors to determine, based at least in part on the selection of the plurality of stored data segments satisfying the locality criterion, that a first data segment sketch for a first data segment included in the portion of the one or more of the data stream and the data block being processed for storage is similar to one or more data segment sketches amongst data segment sketches of a limited sketch index corresponding to the data segments in the determined locale, wherein when it is determined the first data segment sketch is not similar to the one or more data segment sketches amongst data segment sketches of the limited sketch index, the delta compression module is configured to determine whether the first data segment sketch is similar to one or more data segment sketches amongst data segment sketches of a master sketch index.