A Review of multilayer extreme learning machine neural networks

JA Vásquez-Coronel, M Mora, K Vilches - Artificial Intelligence Review, 2023 - Springer
Abstract The Extreme Learning Machine is a single-hidden-layer feedforward learning
algorithm, which has been successfully applied in regression and classification problems in …

Acceleration methods

A d'Aspremont, D Scieur, A Taylor - Foundations and Trends® …, 2021 - nowpublishers.com
This monograph covers some recent advances in a range of acceleration techniques
frequently used in convex optimization. We first use quadratic optimization problems to …

Understanding the acceleration phenomenon via high-resolution differential equations

B Shi, SS Du, MI Jordan, WJ Su - Mathematical Programming, 2022 - Springer
Gradient-based optimization algorithms can be studied from the perspective of limiting
ordinary differential equations (ODEs). Motivated by the fact that existing ODEs do not …

An operator splitting approach for distributed generalized Nash equilibria computation

P Yi, L Pavel - Automatica, 2019 - Elsevier
In this paper, we propose a distributed algorithm for computation of a generalized Nash
equilibrium (GNE) in noncooperative games over networks. We consider games in which the …

Fast optimization via inertial dynamics with closed-loop damping

H Attouch, RI Boţ, ER Csetnek - Journal of the European Mathematical …, 2022 - ems.press
In a real Hilbert space H, in order to develop fast optimization methods, we analyze the
asymptotic behavior, as time t tends to infinity, of a large class of autonomous dissipative …

Inertial projection and contraction algorithms for variational inequalities

QL Dong, YJ Cho, LL Zhong, TM Rassias - Journal of Global Optimization, 2018 - Springer
In this article, we introduce an inertial projection and contraction algorithm by combining
inertial type algorithms with the projection and contraction algorithm for solving a variational …

Golden ratio algorithms for variational inequalities

Y Malitsky - Mathematical Programming, 2020 - Springer
The paper presents a fully adaptive algorithm for monotone variational inequalities. In each
iteration the method uses two previous iterates for an approximation of the local Lipschitz …

First-order optimization algorithms via inertial systems with Hessian driven damping

H Attouch, Z Chbani, J Fadili, H Riahi - Mathematical Programming, 2022 - Springer
In a Hilbert space setting, for convex optimization, we analyze the convergence rate of a
class of first-order algorithms involving inertial features. They can be interpreted as discrete …

Proximal gradient method for nonsmooth optimization over the Stiefel manifold

S Chen, S Ma, A Man-Cho So, T Zhang - SIAM Journal on Optimization, 2020 - SIAM
We consider optimization problems over the Stiefel manifold whose objective function is the
summation of a smooth function and a nonsmooth function. Existing methods for solving this …

A dynamical systems perspective on Nesterov acceleration

M Muehlebach, M Jordan - International Conference on …, 2019 - proceedings.mlr.press
We present a dynamical system framework for understanding Nesterov's accelerated
gradient method. In contrast to earlier work, our derivation does not rely on a vanishing step …