Patent ID: 11868363
Assignee: KINAXIS INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. A system for persisting and reconciling one or more data sources, the system comprising one or more processors and a data storage, the one or more processors configured to execute, or direct to be executed:
an extract-transform-load module to:
periodically extract batch data from at least one primary data source;
transform the batch data into a first format specified by a data schema for a database; and
load the transformed batch data into the database;

a real-time distributed processing module to:
continuously receive real-time data from at least one secondary data source; and
index the received real-time data to generate an index;
transform the real-time data into the first format, wherein transforming the real-time data comprises discarding any real-time data that is available in the batch data;
load the transformed real-time data into the database;
store the real-time data by key-value in a distributed key-value store for subsequent integration into the database; and
transform the real-time data by transforming the real-time data stored in the distributed key-value store,

and
at least one business intelligence tool to generate business intelligence reports comprising the real-time data in the index, the transformed real-time data in the database, the extracted batch data and the transformed batch data in the database.