Patent ID: 8566336

Claim:
A network device, comprising: a data store configured to include a record about an existing item that has been previously processed, wherein the record includes two or more item identifiers about the existing item; a transceiver for receiving an item over a network; and a processor for enabling actions, comprising: generating two or more item identifiers about the item, wherein each of the two or more item identifiers is generated from at least some different data associated with the item, and wherein generating the two or more item identifiers includes: obtaining a stored end of item pointer based on a first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the existing item; and generating a second item identifier based on a predetermined amount of content at an end portion of the item, wherein the end portion is associated with the stored end of item pointer; determining whether the item is a new item based on a comparison of the generated two or more item identifiers and the two or more item identifiers about the existing item in the record, wherein the new item is separate from the existing item; and when it is determined that the item is the new item based on the comparison, storing an other record about the new item in the data store, wherein the other record includes at least the generated two or more item identifiers about the new item.