Elastic scaling for data stream processing

B Gedik, S Schneider, M Hirzel… - IEEE Transactions on …, 2013 - ieeexplore.ieee.org
This article addresses the profitability problem associated with auto-parallelization of
general-purpose distributed data stream processing applications. Auto-parallelization …

Adaptive input admission and management for parallel stream processing

C Balkesen, N Tatbul, MT Özsu - … of the 7th ACM international conference …, 2013 - dl.acm.org
In this paper, we propose a framework for adaptive admission control and management of a
large number of dynamic input streams in parallel stream processing engines. The …

Elastic symbiotic scaling of operators and resources in stream processing systems

F Lombardi, L Aniello, S Bonomi… - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
Distributed stream processing frameworks are designed to perform continuous computation
on possibly unbounded data streams whose rates can change over time. Devising solutions …

When two choices are not enough: Balancing at scale in distributed stream processing

MAU Nasir, GDF Morales, N Kourtellis… - 2016 IEEE 32nd …, 2016 - ieeexplore.ieee.org
Carefully balancing load in distributed stream processing systems has a fundamental impact
on execution latency and throughput. Load balancing is challenging because real-world …

Latency-aware elastic scaling for distributed data stream processing systems

T Heinze, Z Jerzak, G Hackenbroich… - Proceedings of the 8th …, 2014 - dl.acm.org
Elastic scaling allows a data stream processing system to react to a dynamically changing
query or event workload by automatically scaling in or out. Thereby, both unpredictable load …

Resource management and scheduling in distributed stream processing systems: a taxonomy, review, and future directions

X Liu, R Buyya - ACM Computing Surveys (CSUR), 2020 - dl.acm.org
Stream processing is an emerging paradigm to handle data streams upon arrival, powering
latency-critical application such as fraud detection, algorithmic trading, and health …

The power of both choices: Practical load balancing for distributed stream processing engines

MAU Nasir, GDF Morales… - 2015 IEEE 31st …, 2015 - ieeexplore.ieee.org
We study the problem of load balancing in distributed stream processing engines, which is
exacerbated in the presence of skew. We introduce Partial Key Grouping (PKG), a new …

A comprehensive survey on parallelization and elasticity in stream processing

H Röger, R Mayer - ACM Computing Surveys (CSUR), 2019 - dl.acm.org
Stream Processing (SP) has evolved as the leading paradigm to process and gain value
from the high volume of streaming data produced, eg, in the domain of the Internet of Things …

Optimal operator placement for distributed stream processing applications

V Cardellini, V Grassi, F Lo Presti… - Proceedings of the 10th …, 2016 - dl.acm.org
Data Stream Processing (DSP) applications are widely used to timely extract information
from distributed data sources, such as sensing devices, monitoring stations, and social …

Elastic scaling of data parallel operators in stream processing

S Schneider, H Andrade, B Gedik… - … on parallel & …, 2009 - ieeexplore.ieee.org
We describe an approach to elastically scale the performance of a data analytics operator
that is part of a streaming application. Our techniques focus on dynamically adjusting the …