Acceleration methods

A d'Aspremont, D Scieur, A Taylor - Foundations and Trends® …, 2021 - nowpublishers.com
This monograph covers some recent advances in a range of acceleration techniques
frequently used in convex optimization. We first use quadratic optimization problems to …

Decentralized proximal gradient algorithms with linear convergence rates

SA Alghunaim, EK Ryu, K Yuan… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This article studies a class of nonsmooth decentralized multiagent optimization problems
where the agents aim at minimizing a sum of local strongly-convex smooth components plus …

PEPit: computer-assisted worst-case analyses of first-order optimization methods in Python

B Goujaud, C Moucer, F Glineur, JM Hendrickx… - Mathematical …, 2024 - Springer
PEPit is a python package aiming at simplifying the access to worst-case analyses of a large
family of first-order optimization methods possibly involving gradient, projection, proximal, or …

A unified and refined convergence analysis for non-convex decentralized learning

SA Alghunaim, K Yuan - IEEE Transactions on Signal …, 2022 - ieeexplore.ieee.org
We study the consensus decentralized optimization problem where the objective function is
the average of agents private non-convex cost functions; moreover, the agents can only …

Primal–dual methods for large-scale and distributed convex optimization and data analytics

D Jakovetić, D Bajović, J Xavier… - Proceedings of the …, 2020 - ieeexplore.ieee.org
The augmented Lagrangian method (ALM) is a classical optimization tool that solves a given
“difficult”(constrained) problem via finding solutions of a sequence of “easier”(often …

The analysis of optimization algorithms: A dissipativity approach

L Lessard - IEEE Control Systems Magazine, 2022 - ieeexplore.ieee.org
Optimization problems in engineering and applied mathematics are typically solved in an
iterative fashion, by systematically adjusting the variables of interest until an adequate …

Distributed optimization methods for multi-robot systems: Part 2—A survey

O Shorinwa, T Halsted, J Yu… - IEEE Robotics & …, 2024 - ieeexplore.ieee.org
Although the field of distributed optimization is well developed, relevant literature focused on
the application of distributed optimization to multi-robot problems is limited. This survey …

Towards a systems theory of algorithms

F Dörfler, Z He, G Belgioioso… - IEEE Control …, 2024 - ieeexplore.ieee.org
Traditionally, numerical algorithms are seen as isolated pieces of code confined to an in
silico existence. However, this perspective is inappropriate for many modern computational …

The gradient tracking is a distributed integral action

I Notarnicola, M Bin, L Marconi… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
We revisit the recent gradient tracking algorithm for distributed consensus optimization from
a control theoretic viewpoint. We show that the algorithm can be constructed by solving a …

Distributed and inexact proximal gradient method for online convex optimization

N Bastianello, E Dall'Anese - 2021 European Control …, 2021 - ieeexplore.ieee.org
This paper develops and analyzes an online distributed proximal-gradient method (DPGM)
for time-varying composite convex optimization problems. Each node of the network features …