Patent ID: 8799235
Filing Date: 2014-08-05
Classification: G06F

Abstract:
1. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to manage duplicate data originating from a plurality of data sources, the managing of the duplicate data comprising: generating one or more de-duplication instructions for a data warehouse, wherein the one or more de-duplication instructions identify dimension data records that are considered duplicate dimension data records and identify a single dimension data record that represents the duplicate dimension data records; receiving dimension data from a plurality of data sources, wherein the dimension data comprises one or more dimension data records; identifying at least two duplicate dimension data records by applying the one or more de-duplication instructions to the received dimension data; replacing the at least two duplicate dimension data records with the single dimension data record within the data warehouse; adjusting one or more foreign keys of at least one data record within the data warehouse to reference the single dimension data record; receiving one or more additional de-duplication instructions, wherein the one or more additional de-duplication instructions identify dimension data records that are no longer considered duplicate dimension data records; replacing the single dimension data record with the at least two duplicate dimension data records within the data warehouse; and adjusting the one or more foreign keys of the at least one data record within the data warehouse to reference the at least two duplicate dimension data records.