There are many academic and commercial stream processing engines (SPEs) today, each of them with its own execution semantics. This variation may lead to seemingly inexplicable differences in query results. In this paper, we present SECRET, a model of the behavior of SPEs. SECRET is a descriptive model that allows users to analyze the behavior of systems and understand the results of window-based queries for a broad range of heterogeneous SPEs. The model is the result of extensive analysis and experimentation with several commercial and academic engines. In the paper, we describe the types of heterogeneity found in existing engines, and show with experiments on real systems that our model can explain the key differences in windowing behavior.
In particular, a descriptive model is introduced in REF , in order to analyze the behavior of stream processing systems, understand the results of windowed queries, and explain the key differences in windowing behavior across different systems.
SECRET: A Model for Analysis of the Execution Semantics of Stream Processing Systems
PVLDB
PVLDB
Computer Science