Patent ID: 8468135

Claim:
A method of reducing bandwidth consumption for data being sent between a client and server over a wide area network (WAN) by optimizing deduplication performance, the method comprising: partitioning a data message into a plurality of data chunks, said message to be sent from a client at a first data site to a server at a second data site over a WAN; generating a data chunk identifier (ID) for each of said chunks; determining whether said chunks are stored at the second data site; when at least one of said chunks is not stored at the second data site, adding said ID for each of said chunks not stored at the second data site to a data structure at the first data site; when at least two data chunks partitioned from said message are in sequence and are not stored at the second data site, linking in the data structure at the first data site, the data chunk ID for each data chunk in sequence that are not stored at the second data site in an order corresponding to the sequence in said message; and sending a transformed data message from the first date site to the second data site, wherein said transformed message includes at least one tuple when at least one of said chunks is stored at the second data site and data chunks among said chunks that are not stored at the second data site, wherein said tuple: is a paired representation of data chunk sequence, is to be used to reconstruct said message, and includes a first data chunk ID and a sequence count that represents an aggregate number of linked data chunk IDs.