Runtime adaptation of data stream processing systems: The state of the art

V Cardellini, F Lo Presti, M Nardelli… - ACM Computing …, 2022 - dl.acm.org
Data stream processing (DSP) has emerged over the years as the reference paradigm for
the analysis of continuous and fast information flows, which often have to be processed with …

A comprehensive survey on parallelization and elasticity in stream processing

H Röger, R Mayer - ACM Computing Surveys (CSUR), 2019 - dl.acm.org
Stream Processing (SP) has evolved as the leading paradigm to process and gain value
from the high volume of streaming data produced, eg, in the domain of the Internet of Things …

Resource management and scheduling in distributed stream processing systems: a taxonomy, review, and future directions

X Liu, R Buyya - ACM Computing Surveys (CSUR), 2020 - dl.acm.org
Stream processing is an emerging paradigm to handle data streams upon arrival, powering
latency-critical application such as fraud detection, algorithmic trading, and health …

More on pipelined dynamic scheduling of big data streams

S Souravlas, S Anastasiadou, S Katsavounis - Applied Sciences, 2020 - mdpi.com
An important as well as challenging task in modern applications is the management and
processing with very short delays of large data volumes. It is quite often, that the capabilities …

Self‐adaptation on parallel stream processing: A systematic review

A Vogel, D Griebler, M Danelutto… - Concurrency and …, 2022 - Wiley Online Library
A recurrent challenge in real‐world applications is autonomous management of the
executions at run‐time. In this vein, stream processing is a class of applications that compute …

Reinforcement learning based policies for elastic stream processing on heterogeneous resources

GR Russo, V Cardellini, FL Presti - proceedings of the 13th ACM …, 2019 - dl.acm.org
Data Stream Processing (DSP) has emerged as a key enabler to develop pervasive services
that require to process data in a near real-time fashion. DSP applications keep up with the …

Elastic scaling for distributed latency-sensitive data stream operators

T De Matteis, G Mencagli - 2017 25th Euromicro International …, 2017 - ieeexplore.ieee.org
High-volume data streams are straining the limits of stream processing frameworks which
need advanced parallel processing capabilities to withstand the actual incoming bandwidth …

SP-ant: An ant colony optimization based operator scheduler for high performance distributed stream processing on heterogeneous clusters

M Farrokh, H Hadian, M Sharifi, A Jafari - Expert Systems with Applications, 2022 - Elsevier
A key feature of distributed stream processing (DSP) systems is the scheduling of operators
on clustered computers. In scheduling, the assignment plan of operators to nodes of the …

TCEP: Adapting to dynamic user environments by enabling transitions between operator placement mechanisms

M Luthra, B Koldehofe, P Weisenburger… - Proceedings of the 12th …, 2018 - dl.acm.org
Operator placement has a profound impact on the performance of a distributed complex
event processing system (DCEP). Since the behavior of a placement mechanism strongly …

Hierarchical Auto-scaling Policies for Data Stream Processing on Heterogeneous Resources

G Russo Russo, V Cardellini, F Lo Presti - ACM Transactions on …, 2023 - dl.acm.org
Data Stream Processing (DSP) applications analyze data flows in near real-time by means
of operators, which process and transform incoming data. Operators handle high data rates …