Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

B Bischl, M Binder, M Lang, T Pielok… - … : Data Mining and …, 2023 - Wiley Online Library
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …

Recent advances in Bayesian optimization

X Wang, Y Jin, S Schmitt, M Olhofer - ACM Computing Surveys, 2023 - dl.acm.org
Bayesian optimization has emerged at the forefront of expensive black-box optimization due
to its data efficiency. Recent years have witnessed a proliferation of studies on the …

BoTorch: A framework for efficient Monte-Carlo Bayesian optimization

M Balandat, B Karrer, D Jiang… - Advances in neural …, 2020 - proceedings.neurips.cc
Bayesian optimization provides sample-efficient global optimization for a broad range of
applications, including automatic machine learning, engineering, physics, and experimental …

[PDF][PDF] Hyperparameter optimization

M Feurer, F Hutter - Automated machine learning: Methods …, 2019 - library.oapen.org
Recent interest in complex and computationally expensive machine learning models with
many hyperparameters, such as automated machine learning (AutoML) frameworks and …

Recent advances in 2D material theory, synthesis, properties, and applications

YC Lin, R Torsi, R Younas, CL Hinkle, AF Rigosi… - ACS …, 2023 - ACS Publications
Two-dimensional (2D) material research is rapidly evolving to broaden the spectrum of
emergent 2D systems. Here, we review recent advances in the theory, synthesis …

A tutorial on Bayesian optimization

PI Frazier - arXiv preprint arXiv:1807.02811, 2018 - arxiv.org
Bayesian optimization is an approach to optimizing objective functions that take a long time
(minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of …

Scalable global optimization via local Bayesian optimization

D Eriksson, M Pearce, J Gardner… - Advances in neural …, 2019 - proceedings.neurips.cc
Bayesian optimization has recently emerged as a popular method for the sample-efficient
optimization of expensive black-box functions. However, the application to high-dimensional …

Bayesian optimization for adaptive experimental design: A review

S Greenhill, S Rana, S Gupta, P Vellanki… - IEEE …, 2020 - ieeexplore.ieee.org
Bayesian optimisation is a statistical method that efficiently models and optimises expensive
“black-box” functions. This review considers the application of Bayesian optimisation to …

Bayesian optimization

PI Frazier - Recent advances in optimization and modeling …, 2018 - pubsonline.informs.org
Bayesian optimization is an approach to optimizing objective functions that take a long time
(minutes or hours) to evaluate. It is best suited for optimization over continuous domains of …

Hyperband: A novel bandit-based approach to hyperparameter optimization

L Li, K Jamieson, G DeSalvo, A Rostamizadeh… - Journal of Machine …, 2018 - jmlr.org
Performance of machine learning algorithms depends critically on identifying a good set of
hyperparameters. While recent approaches use Bayesian optimization to adaptively select …