On the global convergence of particle swarm optimization methods

H Huang, J Qiu, K Riedl - Applied Mathematics & Optimization, 2023 - Springer
In this paper we provide a rigorous convergence analysis for the renowned particle swarm
optimization method by using tools from stochastic calculus and the analysis of partial …

Constrained consensus-based optimization

G Borghi, M Herty, L Pareschi - SIAM Journal on Optimization, 2023 - SIAM
In this work we are interested in the construction of numerical methods for high-dimensional
constrained nonlinear optimization problems by particle-based gradient-free techniques. A …

Zero-inertia limit: from particle swarm optimization to consensus-based optimization

C Cipriani, H Huang, J Qiu - SIAM Journal on Mathematical Analysis, 2022 - SIAM
Recently a continuous description of particle swarm optimization (PSO) based on a system
of stochastic differential equations was proposed by Grassi and Pareschi in [Math. Models …

Mean-field particle swarm optimization

S Grassi, H Huang, L Pareschi, J Qiu - Modeling and Simulation for …, 2023 - World Scientific
In this chapter we survey some recent results on the global minimization of a non-convex
and possibly non-smooth high dimensional objective function by means of particle-based …

Ensemble-based gradient inference for particle methods in optimization and sampling

C Schillings, C Totzeck, P Wacker - SIAM/ASA Journal on Uncertainty …, 2023 - SIAM
We propose an approach based on function evaluations and Bayesian inference to extract
higher-order differential information of objective functions from a given ensemble of …

Kinetic models for optimization: a unified mathematical framework for metaheuristics

G Borghi, M Herty, L Pareschi - arXiv preprint arXiv:2410.10369, 2024 - arxiv.org
Metaheuristic algorithms, widely used for solving complex non-convex and non-
differentiable optimization problems, often lack a solid mathematical foundation. In this …

Binary interaction methods for high dimensional global optimization and machine learning

A Benfenati, G Borghi, L Pareschi - Applied Mathematics & Optimization, 2022 - Springer
In this work we introduce a new class of gradient-free global optimization methods based on
a binary interaction dynamics governed by a Boltzmann type equation. In each interaction …

On the mean field limit of consensus based methods

M Koß, S Weissmann, J Zech - arXiv preprint arXiv:2409.03518, 2024 - arxiv.org
Consensus based optimization (CBO) employs a swarm of particles evolving as a system of
stochastic differential equations (SDEs). Recently, it has been adapted to yield a derivative …

Analysis of a Consensus-based Optimization Method on Hypersurfaces and Applications

P Sünnen - 2023 - mediatum.ub.tum.de
Constrained optimization problems with non-convex cost function are ubiquitous in science
and engineering. One class of methods to solve such optimization problems are so-called …