Patent ID: 8843517

Claim:
A method for data storage using a plurality of storage devices, comprising: obtaining, by a processor of a computer system from a network data source, first and second data records that are delimited based on network data payload format of the network data source and independent of characteristics of the plurality of storage devices; generating, by the processor and using a pre-determined algorithm for multiplexing the plurality of storage devices, first and second meta-data identifying first and second locations, respectively, in the plurality of storage devices to store the first and second data records, respectively, wherein the first and second meta-data comprise a size of the first and second locations; combining the first data record and the first meta-data to generate a first composite data record; combining the second data record and the second meta-data to generate a second composite data record; storing, based on the first and second meta-data, the first and second composite data records concurrently in the first and second locations, respectively, wherein first and second write elapse time to store the first and second composite data records, respectively, are overlapped; storing the first and second meta-data in a data store separate from the plurality of storage devices, wherein the first and second meta-data are indexed in the data store based on first and second identifiers of the first and second data records, respectively; and retrieving, in response to a request based on the first and second identifiers, the first and second data records concurrently from the plurality of storage devices using the first and second meta-data, respectively, wherein first and second read elapse time to retrieve the first and second data records, respectively, are overlapped, wherein retrieving the first data record based on the first identifier comprises: retrieving, using the first identifier, the first meta-data from the data store to generate retrieved first meta-data; extracting, from the retrieved first meta-data, information regarding the first location; retrieving, based on the information regarding the first location, the first composite data record from the first location to generate retrieved first composite data record; comparing the retrieved first composite data record to the retrieved first meta-data to determine a mismatch; and generating an alert, in response to the mismatch.