Acceleration methods
This monograph covers some recent advances in a range of acceleration techniques
frequently used in convex optimization. We first use quadratic optimization problems to …
frequently used in convex optimization. We first use quadratic optimization problems to …
The first optimal acceleration of high-order methods in smooth convex optimization
D Kovalev, A Gasnikov - Advances in Neural Information …, 2022 - proceedings.neurips.cc
In this paper, we study the fundamental open question of finding the optimal high-order
algorithm for solving smooth convex minimization problems. Arjevani et al.(2019) …
algorithm for solving smooth convex minimization problems. Arjevani et al.(2019) …
Quantum speedups for stochastic optimization
We consider the problem of minimizing a continuous function given given access to a
natural quantum generalization of a stochastic gradient oracle. We provide two new …
natural quantum generalization of a stochastic gradient oracle. We provide two new …
Optimal and adaptive monteiro-svaiter acceleration
Y Carmon, D Hausler, A Jambulapati… - Advances in Neural …, 2022 - proceedings.neurips.cc
We develop a variant of the Monteiro-Svaiter (MS) acceleration framework that removes the
need to solve an expensive implicit equation at every iteration. Consequently, for any $ p\ge …
need to solve an expensive implicit equation at every iteration. Consequently, for any $ p\ge …
Near Optimal Methods for Minimizing Convex Functions with Lipschitz -th Derivatives
A Gasnikov, P Dvurechensky… - … on Learning Theory, 2019 - proceedings.mlr.press
In this merged paper, we consider the problem of minimizing a convex function with
Lipschitz-continuous $ p $-th order derivatives. Given an oracle which when queried at a …
Lipschitz-continuous $ p $-th order derivatives. Given an oracle which when queried at a …
[图书][B] Evaluation Complexity of Algorithms for Nonconvex Optimization: Theory, Computation and Perspectives
Do you know the difference between an optimist and a pessimist? The former believes we
live in the best possible world, and the latter is afraid that the former might be right.… In that …
live in the best possible world, and the latter is afraid that the former might be right.… In that …
Near-optimal method for highly smooth convex optimization
We propose a near-optimal method for highly smooth convex optimization. More precisely,
in the oracle model where one obtains the $ p^{th} $ order Taylor expansion of a function at …
in the oracle model where one obtains the $ p^{th} $ order Taylor expansion of a function at …
Near-optimal methods for minimizing star-convex functions and beyond
In this paper, we provide near-optimal accelerated first-order methods for minimizing a
broad class of smooth nonconvex functions that are unimodal on all lines through a …
broad class of smooth nonconvex functions that are unimodal on all lines through a …
Unifying Nesterov's accelerated gradient methods for convex and strongly convex objective functions
J Kim, I Yang - International Conference on Machine …, 2023 - proceedings.mlr.press
Although Nesterov's accelerated gradient method (AGM) has been studied from various
perspectives, it remains unclear why the most popular forms of AGMs must handle convex …
perspectives, it remains unclear why the most popular forms of AGMs must handle convex …
Accelerated quasi-newton proximal extragradient: Faster rate for smooth convex optimization
R Jiang, A Mokhtari - Advances in Neural Information …, 2024 - proceedings.neurips.cc
In this paper, we propose an accelerated quasi-Newton proximal extragradient method for
solving unconstrained smooth convex optimization problems. With access only to the …
solving unconstrained smooth convex optimization problems. With access only to the …