Mjolnir: A framework agnostic auto-tuning system with deep reinforcement learning

NB Slimane, H Sagaama, M Marwani… - Applied …, 2023 - search.proquest.com
Choosing the right setting for big data frameworks is an important yet difficult task. These
frameworks come with a complex set of parameters that need to be tuned to achieve the best …

Mjolnir: A framework agnostic auto-tuning system with deep reinforcement learning

N Ben Slimane, H Sagaama, M Marwani, S Skhiri - Applied Intelligence, 2023 - Springer
Choosing the right setting for big data frameworks is an important yet difficult task. These
frameworks come with a complex set of parameters that need to be tuned to achieve the best …

Pets: Bottleneck-aware spark tuning with parameter ensembles

TBG Perez, W Chen, R Ji, L Liu… - 2018 27th International …, 2018 - ieeexplore.ieee.org
Spark tuning with its dozens of parameters for performance improvement is both a challenge
and time consuming effort. Current techniques rely on trial-and-error or best guess utilizing …

Adaptive code learning for spark configuration tuning

C Lin, J Zhuang, J Feng, H Li… - 2022 IEEE 38th …, 2022 - ieeexplore.ieee.org
Configuration tuning is vital to optimize the performance of big data analysis platforms like
Spark. Existing methods (eg auto-tuning relational databases) are not effective for tuning …

You only run once: spark auto-tuning from a single run

DB Prats, FA Portella, CHA Costa… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Tuning configurations of Spark jobs is not a trivial task. State-of-the-art auto-tuning systems
are based on iteratively running workloads with different configurations. During the …

Policy adaptive multi-agent deep deterministic policy gradient

Y Wang, F Wu - International Conference on Principles and Practice of …, 2020 - Springer
We propose a novel approach to address one aspect of the non-stationarity problem in multi-
agent reinforcement learning (RL), where the other agents may alter their policies due to …

Towards general and efficient online tuning for spark

Y Li, H Jiang, Y Shen, Y Fang, X Yang, D Huang… - arXiv preprint arXiv …, 2023 - arxiv.org
The distributed data analytic system--Spark is a common choice for processing massive
volumes of heterogeneous data, while it is challenging to tune its parameters to achieve …

[PDF][PDF] Continuous Tactical Optimism and Pessimism

K Bharadwaj, B Ravindran - Third Conference on …, 2023 - alaworkshop2023.github.io
In the field of reinforcement learning for continuous control, deep off-policy actor-critic
algorithms have become a popular approach due to their ability to address function …

Onestoptuner: an end to end architecture for jvm tuning of spark applications

PB Bindal, D Singhal, AV Subramanyam… - arXiv preprint arXiv …, 2020 - arxiv.org
Java is the backbone of widely used big data frameworks, such as Apache Spark, due to its
productivity, portability from JVM-based execution, and support for a rich set of libraries …

Tactical optimism and pessimism for deep reinforcement learning

T Moskovitz, J Parker-Holder… - Advances in …, 2021 - proceedings.neurips.cc
In recent years, deep off-policy actor-critic algorithms have become a dominant approach to
reinforcement learning for continuous control. One of the primary drivers of this improved …