Runtime adaptation of data stream processing systems: The state of the art

V Cardellini, F Lo Presti, M Nardelli… - ACM Computing …, 2022 - dl.acm.org
… systems focus on specific processing paradigms, such as complex event processing (CEP), …
primitive event streams (eg, sensor measurements). Real-time stream processing is usually …

Compiling for stream processing

A Das, WJ Dally, P Mattson - … of the 15th international conference on …, 2006 - dl.acm.org
… The generated microcode are loaded at runtime to execute kernels. The first phase of the
compiler, summarized by the flowchart in Figure 3, is described in the following sections. …

Drizzle: Fast and adaptable stream processing at scale

S Venkataraman, A Panda, K Ousterhout… - Proceedings of the 26th …, 2017 - dl.acm.org
… We define the latency of a stream processing system as the time … and as the running time is
dominated by computation we see … We compare the time taken per microbatch while running

Evaluation of stream processing frameworks

G Van Dongen, D Van den Poel - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
stream processing pipelines for most use cases, as can be inferred from the documentation
of these frameworks [14], [16], [17], [18]: basic operations, joining, windowing and processing

Elastic scaling for data stream processing

B Gedik, S Schneider, M Hirzel… - IEEE Transactions on …, 2013 - ieeexplore.ieee.org
… We presented an auto-parallelization scheme that can provide elasticity to stream
processing applications. It is able to adjust the number of parallel channels to use at runtime, …

Runtime semantic query optimization for event stream processing

L Ding, S Chen, EA Rundensteiner… - 2008 IEEE 24th …, 2008 - ieeexplore.ieee.org
… transaction streams. Since the optimization opportunities arise at runtime, we develop a
runtime query … the query failure conditions to be checked at runtime. This guarantees a constant-…

Runtime‐aware adaptive scheduling in stream processing

Y Liu, X Shi, H Jin - Concurrency and Computation: Practice …, 2016 - Wiley Online Library
… -running stream applications usually share the same fundamental computational infrastructure.
To improve the efficiency of data processing in stream processing … , (1) stream input rates …

The 8 requirements of real-time stream processing

M Stonebraker, U Çetintemel, S Zdonik - ACM Sigmod Record, 2005 - dl.acm.org
… Although a traditional SQL system knows it is finished computing when it gets to the end of
a table, because streaming data never ends, a stream processing engine must be instructed …

Benchmarking distributed stream data processing systems

J Karimov, T Rabl, A Katsifodimos… - 2018 IEEE 34th …, 2018 - ieeexplore.ieee.org
stream analysis has led to the development of many open-source streaming data processing
… In this paper, we propose a framework for benchmarking distributed stream processing

A catalog of stream processing optimizations

M Hirzel, R Soulé, S Schneider, B Gedik… - ACM Computing Surveys …, 2014 - dl.acm.org
… , databases, operating systems, and complex event processing… a survey of optimizations
for stream processing. It is aimed … We hope that this survey will help future streaming system …