A comprehensive survey on parallelization and elasticity in stream processing

H Röger, R Mayer - ACM Computing Surveys (CSUR), 2019 - dl.acm.org
Stream Processing (SP) has evolved as the leading paradigm to process and gain value
from the high volume of streaming data produced, eg, in the domain of the Internet of Things …

A survey on the evolution of stream processing systems

M Fragkoulis, P Carbone, V Kalavri, A Katsifodimos - The VLDB Journal, 2024 - Springer
Stream processing has been an active research field for more than 20 years, but it is now
witnessing its prime time due to recent successful efforts by the research community and …

When two choices are not enough: Balancing at scale in distributed stream processing

MAU Nasir, GDF Morales, N Kourtellis… - 2016 IEEE 32nd …, 2016 - ieeexplore.ieee.org
Carefully balancing load in distributed stream processing systems has a fundamental impact
on execution latency and throughput. Load balancing is challenging because real-world …

Elastic symbiotic scaling of operators and resources in stream processing systems

F Lombardi, L Aniello, S Bonomi… - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
Distributed stream processing frameworks are designed to perform continuous computation
on possibly unbounded data streams whose rates can change over time. Devising solutions …

Parallel stream processing against workload skewness and variance

J Fang, R Zhang, TZJ Fu, Z Zhang, A Zhou… - Proceedings of the 26th …, 2017 - dl.acm.org
Key-based workload partitioning is a common strategy used in parallel stream processing
engines, enabling effective key-value tuple distribution over worker threads in a logical …

Self-adaptive processing graph with operator fission for elastic stream processing

N Hidalgo, D Wladdimiro, E Rosas - Journal of Systems and Software, 2017 - Elsevier
Nowadays, information generated by the Internet interactions is growing exponentially,
creating massive and continuous flows of events from the most diverse sources. These …

PA-SPS: A Predictive Adaptive Approach for an Elastic Stream Processing System

D Wladdimiro, L Arantes, P Sens, N Hidalgo - Journal of Parallel and …, 2024 - Elsevier
Abstract Stream Processing Systems (SPSs) dynamically process input events. Since the
input is usually not a constant flow, presenting rate fluctuations, many works in the literature …

Qfrag: Distributed graph search via subgraph isomorphism

M Serafini, G De Francisci Morales… - proceedings of the 2017 …, 2017 - dl.acm.org
This paper introduces QFrag, a distributed system for graph search on top of bulk
synchronous processing (BSP) systems such as MapReduce and Spark. Searching for …

A preventive auto-parallelization approach for elastic stream processing

RK Kombi, N Lumineau… - 2017 IEEE 37th …, 2017 - ieeexplore.ieee.org
Nowadays, more and more sources (connected devices, social networks, etc.) emit real-time
data with fluctuating rates over time. Existing distributed stream processing engines (SPE) …

Dalton: learned Partitioning for distributed data streams

E Zapridou, I Mytilinis, A Ailamaki - Proceedings of the VLDB Endowment, 2022 - dl.acm.org
To sustain the input rate of high-throughput streams, modern stream processing systems rely
on parallel execution. However, skewed data yield imbalanced load assignments and create …