Patent ID: 8954392
Filing Date: 2015-02-10
Classification: H03M

Abstract:
1. A method for performing data de-duplication using deep packet inspection, the method comprising: receiving file data carried by a data stream; partitioning a portion of the file data into a data chunk; applying a hash algorithm to data blocks within the data chunk to produce a set of hash values, the set of hash values including at least a first hash value and a second hash value; selecting a subset of hash values from the set of hash values to store in a hash table, the subset of selected hash values including fewer than all hash values in the set of hash values, wherein the subset of selected hash values includes the first hash value and excludes the second hash value; storing the portion of file data in a container in a history; and storing the subset of selected hash values in the hash table without storing non-selected hash values in the hash table, wherein the first hash value is stored in the hash table and the second hash value is excluded from the hash table.