A computing system comprising one or more processors configured to run one or more modules stored in non-transitory computer readable medium, wherein the one or more modules are configured to: receive a first set of data and format the first set of data into a first structured set of data ; process the first structured set of data in batch to generate a first summary data using the first structured set of data , the first summary data includes a first entity identifier and a first value associated with the first entity identifier, and store the first summary data in a data store; receive a second set of data and format the second set of data into a second structured set of data , wherein the second set of data is received during or subsequent to processing the first structured set of data in batch; store the second set of data with the first set of data in a data store to be subsequently reprocessed in batch; process the second structured set of data in substantially real-time to generate a second summary data using the first structured set of data and the second structured set of data , the second summary data includes a second entity identifier and a second value associated with the second entity identifier, and store the second summary data in a data store; determine that the first entity identifier and the second entity identifier are identical; and store the first structured set of data and the second structured set of data clustered by the first entity identifier and the second entity identifier in a data store to allow generation of a new second summary data based on the stored first structured set of data and second structured set of data as a new second set of data is received and processed. receive a first set of data and format the first set of data into a first structured set of data ; process the first structured set of data in batch to generate a first summary data using the first structured set of data , the first summary data includes a first entity identifier and a first value associated with the first entity identifier, and store the first summary data in a data store; receive a second set of data and format the second set of data into a second structured set of data , wherein the second set of data is received during or subsequent to processing the first structured set of data in batch; store the second set of data with the first set of data in a data store to be subsequently reprocessed in batch; process the second structured set of data in substantially real-time to generate a second summary data using the first structured set of data and the second structured set of data , the second summary data includes a second entity identifier and a second value associated with the second entity identifier, and store the second summary data in a data store; determine that the first entity identifier and the second entity identifier are identical; and store the first structured set of data and the second structured set of data clustered by the first entity identifier and the second entity identifier in a data store to allow generation of a new second summary data based on the stored first structured set of data and second structured set of data as a new second set of data is received and processed. <EOS>