Patent ID: 7574429

Claim:
A method comprising: partitioning a data feed file into a plurality of subsets based on an indexed field of the data feed file; calculating a redundancy check value for each of the plurality of subsets; comparing the redundancy check value of each of the plurality of subsets with a redundancy check value of a corresponding stored database file; and if the redundancy check value for a subset is not equal to the redundancy check value of the corresponding stored database file, replacing the corresponding stored database file with said subset, wherein said partitioning step comprises storing a filename for each of the plurality of subsets, said filename comprising a source name of said data feed file, a source timestamp of said data feed file, a field name of said indexed field, and a field value of said indexed field, said method further comprising: storing the redundancy check value of each of the plurality of subsets and associating the redundancy check value with the filename for each of the plurality of subsets.