A comprehensive survey on parallelization and elasticity in stream processing

H Röger, R Mayer - ACM Computing Surveys (CSUR), 2019 - dl.acm.org
Stream Processing (SP) has evolved as the leading paradigm to process and gain value
from the high volume of streaming data produced, eg, in the domain of the Internet of Things …

A survey of state management in big data processing systems

QC To, J Soto, V Markl - The VLDB Journal, 2018 - Springer
The concept of state and its applications vary widely across big data processing systems.
This is evident in both the research literature and existing systems, such as Apache Flink …

Elastic scaling for distributed latency-sensitive data stream operators

T De Matteis, G Mencagli - 2017 25th Euromicro International …, 2017 - ieeexplore.ieee.org
High-volume data streams are straining the limits of stream processing frameworks which
need advanced parallel processing capabilities to withstand the actual incoming bandwidth …

Parallelizing intra-window join on multicores: An experimental study

S Zhang, Y Mao, J He, PM Grulich, S Zeuch… - Proceedings of the …, 2021 - dl.acm.org
The intra-window join (IaWJ), ie, joining two input streams over a single window, is a core
operation in modern stream processing applications. This paper presents the first …

SPECTRE: Supporting consumption policies in window-based parallel complex event processing

R Mayer, A Slo, MA Tariq, K Rothermel… - Proceedings of the 18th …, 2017 - dl.acm.org
Distributed Complex Event Processing (DCEP) is a paradigm to infer the occurrence of
complex situations in the surrounding world from basic events like sensor readings. In doing …

A comparison of big data frameworks on a layered dataflow model

C Misale, M Drocco, M Aldinucci… - Parallel Processing …, 2017 - World Scientific
In the world of Big Data analytics, there is a series of tools aiming at simplifying
programming applications to be executed on clusters. Although each tool claims to provide …

Container-based support for autonomic data stream processing through the fog

A Brogi, G Mencagli, D Neri, J Soldani… - European Conference on …, 2017 - Springer
We present a container-based architecture for supporting autonomic data stream processing
application on fog computing infrastructures. Our architecture runs applications as Docker …

Efficient incremental computation of aggregations over sliding windows

C Zhang, R Akbarinia, F Toumani - … of the 27th ACM SIGKDD Conference …, 2021 - dl.acm.org
Computing aggregation over sliding windows, ie, finite subsets of an unbounded stream, is a
core operation in streaming analytics. We propose PBA (Parallel Boundary Aggregator), a …

Raising the parallel abstraction level for streaming analytics applications

G Mencagli, M Torquati, D Griebler, M Danelutto… - IEEE …, 2019 - ieeexplore.ieee.org
In the stream processing domain, applications are represented by graphs of operators
arbitrarily connected and filled with their business logic code. The APIs of existing Stream …

Paving the way towards high-level parallel pattern interfaces for data stream processing

D del Rio Astorga, MF Dolz, J Fernández… - Future Generation …, 2018 - Elsevier
The emergence of the Internet of Things (IoT) data stream applications has posed a number
of new challenges to existing infrastructures, processing engines, and programming models …