Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

B Bischl, M Binder, M Lang, T Pielok… - … : Data Mining and …, 2023 - Wiley Online Library
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …

Machine learning for combinatorial optimization: a methodological tour d'horizon

Y Bengio, A Lodi, A Prouvost - European Journal of Operational Research, 2021 - Elsevier
This paper surveys the recent attempts, both from the machine learning and operations
research communities, at leveraging machine learning to solve combinatorial optimization …

[PDF][PDF] Taking human out of learning applications: A survey on automated machine learning

Q Yao, M Wang, Y Chen, W Dai, YF Li… - arXiv preprint arXiv …, 2018 - academia.edu
Machine learning techniques have deeply rooted in our everyday life. However, since it is
knowledge-and labor-intensive to pursue good learning performance, humans are heavily …

Benchmark and survey of automated machine learning frameworks

MA Zöller, MF Huber - Journal of artificial intelligence research, 2021 - jair.org
Abstract Machine learning (ML) has become a vital part in many aspects of our daily life.
However, building well performing machine learning applications requires highly …

A survey of methods for automated algorithm configuration

E Schede, J Brandt, A Tornede, M Wever… - Journal of Artificial …, 2022 - jair.org
Algorithm configuration (AC) is concerned with the automated search of the most suitable
parameter configuration of a parametrized algorithm. There is currently a wide variety of AC …

[PDF][PDF] Hyperparameter optimization of hybrid quantum neural networks for car classification

A Sagingalieva, A Kurkin, A Melnikov… - arXiv preprint arXiv …, 2022 - academia.edu
Image recognition is one of the primary applications of machine learning algorithms.
Nevertheless, machine learning models used in modern image recognition systems consist …

Warm-starting and quantum computing: A systematic mapping study

F Truger, J Barzen, M Bechtold, M Beisel… - ACM Computing …, 2024 - dl.acm.org
Due to low numbers of qubits and their error-proneness, Noisy Intermediate-Scale Quantum
(NISQ) computers impose constraints on the size of quantum algorithms they can …

Hyp-rl: Hyperparameter optimization by reinforcement learning

HS Jomaa, J Grabocka, L Schmidt-Thieme - arXiv preprint arXiv …, 2019 - arxiv.org
Hyperparameter tuning is an omnipresent problem in machine learning as it is an integral
aspect of obtaining the state-of-the-art performance for any model. Most often …

Efficient hyperparameter optimization through model-based reinforcement learning

J Wu, SP Chen, XY Liu - Neurocomputing, 2020 - Elsevier
Hyperparameter tuning is critical for the performance of machine learning algorithms.
However, a noticeable limitation is the high computational cost of algorithm evaluation for …

Towards green automated machine learning: Status quo and future directions

T Tornede, A Tornede, J Hanselle, F Mohr… - Journal of Artificial …, 2023 - jair.org
Automated machine learning (AutoML) strives for the automatic configuration of machine
learning algorithms and their composition into an overall (software) solution—a machine …