Patent ID: 8185352

Claim:
An information processing system for benchmarking a stream processing system, the information processing system comprising: a storage memory to store machine instructions; and a processor in communication with the storage memory, said processor configured to access the memory, the processor performing; generating a plurality of correlated test streams, wherein each test stream in the plurality of correlated test streams includes a semantically related embedded data set; providing the plurality of correlated test streams to at least one stream processing system; generating a summary of each semantically related embedded data set, wherein the storage memory is configured to store at least one copy of each summary; generating a common identifier associated with each test stream in the plurality of correlated test streams and for embedding the common identifier within each stream in the plurality of correlated test streams, wherein the common identifier is transparent to the at least one stream processing system so as not to affect the set of correlation results, and wherein the common identifier uniquely identifies the plurality of correlated test streams; extracting the common identifier from the output data set generated by the stream processing system; comparing at least one of the copies of the summary of the semantically related embedded data and the common identifier to an output data set including a set of zero or more correlation results generated by the stream processing system; and wherein the comparator compares a copy of each summary which has been stored to the common identifiers extracted from an output data set generated by the stream processing system.