Automatic database knob tuning: a survey

X Zhao, X Zhou, G Li - IEEE Transactions on Knowledge and …, 2023 - ieeexplore.ieee.org
Knob tuning plays an important role in database optimization, which tunes knob settings to
optimize the database performance or improve resource utilization. However, there are …

Autoindex: An incremental index management system for dynamic workloads

X Zhou, L Liu, W Li, L Jin, S Li… - 2022 IEEE 38th …, 2022 - ieeexplore.ieee.org
Indexes are vital to enhance the lookup on single or multiple columns, and building proper
indexes can significantly improve the database performance. Existing works focus on adding …

Tuning parameters of Apache Spark with Gauss–Pareto-based multi-objective optimization

MM Öztürk - Knowledge and Information Systems, 2024 - Springer
When there is a need to make an ultimate decision about the unique features of big data
platforms, one should note that they have configurable parameters. Apache Spark is an …

[PDF][PDF] LST-Bench: Benchmarking Log-Structured Tables in the Cloud

J Camacho-Rodríguez, A Agrawal… - Proceedings of the …, 2024 - dl.acm.org
Data processing engines increasingly leverage distributed file systems for scalable, cost-
effective storage. While the Apache Parquet columnar format has become a popular choice …

Code-aware cross-program transfer hyperparameter optimization

Z Wang, X He, K Chen, C Lin, J Su - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Hyperparameter tuning is an essential task in automatic machine learning and big data
management. To accelerate tuning, many recent studies focus on augmenting BO, the …

Design and evaluation of adaptive system for big data cyber security analytics

F Ullah, MA Babar, A Aleti - Expert Systems with Applications, 2022 - Elsevier
Abstract Big Data Cyber Security Analytics (BDCA) systems leverage big data technologies
to collect, store, and analyze a large volume of security event data for detecting cyber …

DeepCAT: A Cost-Efficient Online Configuration Auto-Tuning Approach for Big Data Frameworks

H Dou, Y Wang, Y Zhang, P Chen - Proceedings of the 51st International …, 2022 - dl.acm.org
To support different application scenarios, big data frameworks usually provide a large
number of performance-related configuration parameters. Online auto-tuning these …

Automatic Configuration Tuning on Cloud Database: A Survey

L Zhang, MA Babar - arXiv preprint arXiv:2404.06043, 2024 - arxiv.org
Faced with the challenges of big data, modern cloud database management systems are
designed to efficiently store, organize, and retrieve data, supporting optimal performance …

Towards verified scalable parallel computing with Coq and Spark

F Loulergue, J Philippe - Proceedings of the 25th ACM International …, 2023 - dl.acm.org
SyDPaCC (Systematic Development of programs for Parallel and Cloud Computing) is a
framework for the Coq interactive theorem prover. It allows to systematically develop correct …

TurBO: A cost-efficient configuration-based auto-tuning approach for cluster-based big data frameworks

H Dou, L Zhang, Y Zhang, P Chen, Z Zheng - Journal of Parallel and …, 2023 - Elsevier
Big data processing frameworks such as Spark usually provide a large number of
performance-related configuration parameters, how to auto-tune these parameters for a …