Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

B Bischl, M Binder, M Lang, T Pielok… - … : Data Mining and …, 2023 - Wiley Online Library
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …

Recent advances and applications of surrogate models for finite element method computations: a review

J Kudela, R Matousek - Soft Computing, 2022 - Springer
The utilization of surrogate models to approximate complex systems has recently gained
increased popularity. Because of their capability to deal with black-box problems and lower …

Global prevalence of non-perennial rivers and streams

ML Messager, B Lehner, C Cockburn, N Lamouroux… - Nature, 2021 - nature.com
Flowing waters have a unique role in supporting global biodiversity, biogeochemical cycles
and human societies,,,–. Although the importance of permanent watercourses is well …

Interpretable machine learning–a brief history, state-of-the-art and challenges

C Molnar, G Casalicchio, B Bischl - Joint European conference on …, 2020 - Springer
We present a brief history of the field of interpretable machine learning (IML), give an
overview of state-of-the-art interpretation methods and discuss challenges. Research in IML …

[PDF][PDF] Hyperparameter optimization

M Feurer, F Hutter - Automated machine learning: Methods …, 2019 - library.oapen.org
Recent interest in complex and computationally expensive machine learning models with
many hyperparameters, such as automated machine learning (AutoML) frameworks and …

[HTML][HTML] Benchmark for filter methods for feature selection in high-dimensional classification data

A Bommert, X Sun, B Bischl, J Rahnenführer… - … Statistics & Data Analysis, 2020 - Elsevier
Feature selection is one of the most fundamental problems in machine learning and has
drawn increasing attention due to high-dimensional data sets emerging from different fields …

Hyperparameter optimization: Comparing genetic algorithm against grid search and bayesian optimization

H Alibrahim, SA Ludwig - 2021 IEEE Congress on Evolutionary …, 2021 - ieeexplore.ieee.org
The performance of machine learning algorithms are affected by several factors, some of
these factors are related to data quantity, quality, or its features. Another element is the …

Auto-sklearn 2.0: Hands-free automl via meta-learning

M Feurer, K Eggensperger, S Falkner… - Journal of Machine …, 2022 - jmlr.org
Automated Machine Learning (AutoML) supports practitioners and researchers with the
tedious task of designing machine learning pipelines and has recently achieved substantial …

Tunability: Importance of hyperparameters of machine learning algorithms

P Probst, AL Boulesteix, B Bischl - Journal of Machine Learning Research, 2019 - jmlr.org
Modern supervised machine learning algorithms involve hyperparameters that have to be
set before running them. Options for setting hyperparameters are default values from the …

TSE-IDS: A two-stage classifier ensemble for intelligent anomaly-based intrusion detection system

BA Tama, M Comuzzi, KH Rhee - IEEE access, 2019 - ieeexplore.ieee.org
Intrusion detection systems (IDSs) play a pivotal role in computer security by discovering
and repealing malicious activities in computer networks. Anomaly-based IDS, in particular …