Acceleration methods

A d'Aspremont, D Scieur, A Taylor - Foundations and Trends® …, 2021 - nowpublishers.com
This monograph covers some recent advances in a range of acceleration techniques
frequently used in convex optimization. We first use quadratic optimization problems to …

The first optimal acceleration of high-order methods in smooth convex optimization

D Kovalev, A Gasnikov - Advances in Neural Information …, 2022 - proceedings.neurips.cc
In this paper, we study the fundamental open question of finding the optimal high-order
algorithm for solving smooth convex minimization problems. Arjevani et al.(2019) …

Quantum speedups for stochastic optimization

A Sidford, C Zhang - Advances in Neural Information …, 2024 - proceedings.neurips.cc
We consider the problem of minimizing a continuous function given given access to a
natural quantum generalization of a stochastic gradient oracle. We provide two new …

Optimal and adaptive monteiro-svaiter acceleration

Y Carmon, D Hausler, A Jambulapati… - Advances in Neural …, 2022 - proceedings.neurips.cc
We develop a variant of the Monteiro-Svaiter (MS) acceleration framework that removes the
need to solve an expensive implicit equation at every iteration. Consequently, for any $ p\ge …

Near Optimal Methods for Minimizing Convex Functions with Lipschitz -th Derivatives

A Gasnikov, P Dvurechensky… - … on Learning Theory, 2019 - proceedings.mlr.press
In this merged paper, we consider the problem of minimizing a convex function with
Lipschitz-continuous $ p $-th order derivatives. Given an oracle which when queried at a …

[图书][B] Evaluation Complexity of Algorithms for Nonconvex Optimization: Theory, Computation and Perspectives

C Cartis, NIM Gould, PL Toint - 2022 - SIAM
Do you know the difference between an optimist and a pessimist? The former believes we
live in the best possible world, and the latter is afraid that the former might be right.… In that …

Near-optimal method for highly smooth convex optimization

S Bubeck, Q Jiang, YT Lee, Y Li… - … on Learning Theory, 2019 - proceedings.mlr.press
We propose a near-optimal method for highly smooth convex optimization. More precisely,
in the oracle model where one obtains the $ p^{th} $ order Taylor expansion of a function at …

Near-optimal methods for minimizing star-convex functions and beyond

O Hinder, A Sidford, N Sohoni - Conference on learning …, 2020 - proceedings.mlr.press
In this paper, we provide near-optimal accelerated first-order methods for minimizing a
broad class of smooth nonconvex functions that are unimodal on all lines through a …

Unifying Nesterov's accelerated gradient methods for convex and strongly convex objective functions

J Kim, I Yang - International Conference on Machine …, 2023 - proceedings.mlr.press
Although Nesterov's accelerated gradient method (AGM) has been studied from various
perspectives, it remains unclear why the most popular forms of AGMs must handle convex …

Accelerated quasi-newton proximal extragradient: Faster rate for smooth convex optimization

R Jiang, A Mokhtari - Advances in Neural Information …, 2024 - proceedings.neurips.cc
In this paper, we propose an accelerated quasi-Newton proximal extragradient method for
solving unconstrained smooth convex optimization problems. With access only to the …