Patent ID: 8442953

Claim:
A processor-implemented method for determining that first information in an input data packet is not redundant with second information previously stored in a database system, the method comprising: receiving an input data packet comprising first information, wherein the first information comprises one or more portions; processing the received input data packet in accordance with coarse and fine political risk data filters to identify one or more political risk relevant portions; determining via a processor portion scores, each portion score associated with each of the political risk relevant portions; applying tags to at least one of the political risk relevant portions; determining a first score comprising a total of the portion scores associated with the political risk relevant tagged portions; generating a database query based on the political risk relevant tagged portions in said input data packet and on the first score; receiving second information based on said database query; comparing said second information with said first information to identify at least a first portion of said first information that is different than said second information based on the first score and a redundancy limit; and facilitating storage of said at least a first portion of said first information in said database system based on the comparison of the first score and the redundancy limit.