Analyzing efficient stream processing on modern hardware

S Zeuch, BD Monte, J Karimov, C Lutz, M Renz… - Proceedings of the …, 2019 - dl.acm.org
Modern Stream Processing Engines (SPEs) process large data volumes under tight latency
constraints. Many SPEs execute processing pipelines using message passing on shared …

Grizzly: Efficient stream processing through adaptive query compilation

PM Grulich, B Sebastian, S Zeuch, J Traub… - Proceedings of the …, 2020 - dl.acm.org
Stream Processing Engines (SPEs) execute long-running queries on unbounded data
streams. They follow an interpretation-based processing model and do not perform runtime …

[PDF][PDF] Efficient Window Aggregation with General Stream Slicing.

J Traub, PM Grulich, AR Cuéllar, S Breß… - EDBT, 2019 - research.tudelft.nl
Window aggregation is a core operation in data stream processing. Existing aggregation
techniques focus on reducing latency, eliminating redundant computations, and minimizing …

Survey of window types for aggregation in stream processing systems

J Verwiebe, PM Grulich, J Traub, V Markl - The VLDB Journal, 2023 - Springer
In this paper, we present the first comprehensive survey of window types for stream
processing systems which have been presented in research and commercial systems. We …

Lightsaber: Efficient window aggregation on multi-core processors

G Theodorakis, A Koliousis, P Pietzuch… - Proceedings of the 2020 …, 2020 - dl.acm.org
Window aggregation queries are a core part of streaming applications. To support window
aggregation efficiently, stream processing engines face a trade-off between exploiting …

Scotty: Efficient window aggregation for out-of-order stream processing

J Traub, PM Grulich, AR Cuellar, S Breß… - 2018 IEEE 34th …, 2018 - ieeexplore.ieee.org
Computing aggregates over windows is at the core of virtually every stream processing job.
Typical stream processing applications involve overlapping windows and, therefore, cause …

Algorithms for Windowed Aggregations and Joins on Distributed Stream Processing Systems

J Verwiebe, PM Grulich, J Traub, V Markl - Datenbank-Spektrum, 2022 - Springer
Window aggregations and windowed joins are central operators of modern real-time
analytic workloads and significantly impact the performance of stream processing systems …

Vid-win: Fast video event matching with query-aware windowing at the edge for the internet of multimedia things

P Yadav, D Salwala, E Curry - IEEE Internet of Things Journal, 2021 - ieeexplore.ieee.org
Efficient video processing is a critical component in many IoMT applications to detect events
of interest. Presently, many window optimization techniques have been proposed in event …

Scotty: General and efficient open-source window aggregation for stream processing systems

J Traub, PM Grulich, AR Cuellar, S Breß… - ACM Transactions on …, 2021 - dl.acm.org
Window aggregation is a core operation in data stream processing. Existing aggregation
techniques focus on reducing latency, eliminating redundant computations, or minimizing …

Optimal and general out-of-order sliding-window aggregation

K Tangwongsan, M Hirzel, S Schneider - Proceedings of the VLDB …, 2019 - dl.acm.org
Sliding-window aggregation derives a user-defined summary of the most-recent portion of a
data stream. For in-order streams, each window change can be handled in O (1) time even …