Derivative-free optimization methods

J Larson, M Menickelly, SM Wild - Acta Numerica, 2019 - cambridge.org
In many optimization problems arising from scientific, engineering and artificial intelligence
applications, objective and constraint functions are available only as the output of a black …

Tuning multigrid methods with robust optimization and local Fourier analysis

J Brown, Y He, S MacLachlan, M Menickelly… - SIAM Journal on Scientific …, 2021 - SIAM
Local Fourier analysis is a useful tool for predicting and analyzing the performance of many
efficient algorithms for the solution of discretized PDEs, such as multigrid and domain …

Derivative-free robust optimization by outer approximations

M Menickelly, SM Wild - Mathematical Programming, 2020 - Springer
We develop an algorithm for minimax problems that arise in robust optimization in the
absence of objective function derivatives. The algorithm utilizes an extension of methods for …

Trust-region methods for the derivative-free optimization of nonsmooth black-box functions

G Liuzzi, S Lucidi, F Rinaldi, LN Vicente - SIAM Journal on Optimization, 2019 - SIAM
In this paper we study the minimization of a nonsmooth black-box type function, without
assuming any access to derivatives or generalized derivatives and without any knowledge …

Survey descent: A multipoint generalization of gradient descent for nonsmooth optimization

XY Han, AS Lewis - SIAM Journal on Optimization, 2023 - SIAM
For strongly convex objectives that are smooth, the classical theory of gradient descent
ensures linear convergence relative to the number of gradient evaluations. An analogous …

Structure-aware methods for expensive derivative-free nonsmooth composite optimization

J Larson, M Menickelly - Mathematical Programming Computation, 2024 - Springer
We present new methods for solving a broad class of bound-constrained nonsmooth
composite minimization problems. These methods are specially designed for objectives that …

Manifold sampling for optimizing nonsmooth nonconvex compositions

J Larson, M Menickelly, B Zhou - SIAM Journal on Optimization, 2021 - SIAM
We propose a manifold sampling algorithm for minimizing a nonsmooth composition f=h∘F,
where we assume h is nonsmooth and may be inexpensively computed in closed form and F …

Derivative-free optimization of a rapid-cycling synchrotron

JS Eldred, J Larson, M Padidar, E Stern… - Optimization and …, 2023 - Springer
We develop and solve a constrained optimization model to identify an integrable optics rapid-
cycling synchrotron lattice design that performs well in several capacities. Our model …

[图书][B] Model-based methods in derivative-free nonsmooth optimization

C Audet, W Hare - 2020 - Springer
Derivative-free optimization (DFO) is the mathematical study of the optimization algorithms
that do not use derivatives. One branch of DFO focuses on model-based DFO methods …

A discussion on variational analysis in derivative-free optimization

W Hare - Set-Valued and Variational Analysis, 2020 - Springer
Variational Analysis studies mathematical objects under small variations. With regards to
optimization, these objects are typified by representations of first-order or second-order …