An insight into bio-inspired and evolutionary algorithms for global optimization: review, analysis, and lessons learnt over a decade of competitions

D Molina, A LaTorre, F Herrera - Cognitive Computation, 2018 - Springer
Over the recent years, continuous optimization has significantly evolved to become the
mature research field it is nowadays. Through this process, evolutionary algorithms had an …

Automated algorithm selection: Survey and perspectives

P Kerschke, HH Hoos, F Neumann… - Evolutionary …, 2019 - ieeexplore.ieee.org
It has long been observed that for practically any computational problem that has been
intensely studied, different instances are best solved using different algorithms. This is …

CMA-ES for hyperparameter optimization of deep neural networks

I Loshchilov, F Hutter - arXiv preprint arXiv:1604.07269, 2016 - arxiv.org
Hyperparameters of deep neural networks are often optimized by grid search, random
search or Bayesian optimization. As an alternative, we propose to use the Covariance Matrix …

Automated algorithm selection on continuous black-box problems by combining exploratory landscape analysis and machine learning

P Kerschke, H Trautmann - Evolutionary computation, 2019 - direct.mit.edu
In this article, we build upon previous work on designing informative and efficient
Exploratory Landscape Analysis features for characterizing problems' landscapes and show …

Combining latent space and structured kernels for Bayesian optimization over combinatorial spaces

A Deshwal, J Doppa - Advances in neural information …, 2021 - proceedings.neurips.cc
We consider the problem of optimizing combinatorial spaces (eg, sequences, trees, and
graphs) using expensive black-box function evaluations. For example, optimizing molecules …

Optimization of wind turbine yaw angles in a wind farm using a three-dimensional yawed wake model

B Dou, T Qu, L Lei, P Zeng - Energy, 2020 - Elsevier
An appropriate yaw angle misalignment of the wind turbines in a wind farm has been found
to improve the average energy production of the turbine array. Predicting the spatial …

[HTML][HTML] Simple deterministic selection-based genetic algorithm for hyperparameter tuning of machine learning models

ID Raji, H Bello-Salau, IJ Umoh, AJ Onumanyi… - Applied Sciences, 2022 - mdpi.com
Hyperparameter tuning is a critical function necessary for the effective deployment of most
machine learning (ML) algorithms. It is used to find the optimal hyperparameter settings of …

Evolutionary algorithms for parameter optimization—thirty years later

THW Bäck, AV Kononova, B van Stein… - Evolutionary …, 2023 - ieeexplore.ieee.org
Thirty years, 1993–2023, is a huge time frame in science. We address some major
developments in the field of evolutionary algorithms, with applications in parameter …

Warm starting CMA-ES for hyperparameter optimization

M Nomura, S Watanabe, Y Akimoto, Y Ozaki… - Proceedings of the …, 2021 - ojs.aaai.org
Hyperparameter optimization (HPO), formulated as black-box optimization (BBO), is
recognized as essential for automation and high performance of machine learning …

Evolutionary computation for wind farm layout optimization

D Wilson, S Rodrigues, C Segura, I Loshchilov… - Renewable energy, 2018 - Elsevier
This paper presents the results of the second edition of the Wind Farm Layout Optimization
Competition, which was held at the 22nd Genetic and Evolutionary Computation …