Spectral projected gradient methods: review and perspectives

EG Birgin, JM Martínez, M Raydan - Journal of Statistical Software, 2014 - jstatsoft.org
Over the last two decades, it has been observed that using the gradient vector as a search
direction in large-scale optimization may lead to efficient algorithms. The effectiveness relies …

On the steplength selection in gradient methods for unconstrained optimization

D Di Serafino, V Ruggiero, G Toraldo… - Applied Mathematics and …, 2018 - Elsevier
The seminal paper by Barzilai and Borwein (1988) has given rise to an extensive
investigation, leading to the development of effective gradient methods. Several steplength …

A family of spectral gradient methods for optimization

YH Dai, Y Huang, XW Liu - Computational Optimization and Applications, 2019 - Springer
We propose a family of spectral gradient methods, whose stepsize is determined by a
convex combination of the long Barzilai–Borwein (BB) stepsize and the short BB stepsize …

An efficient gradient method using the Yuan steplength

R De Asmundis, D Di Serafino, WW Hager… - Computational …, 2014 - Springer
We propose a new gradient method for quadratic programming, named SDC, which
alternates some steepest descent (SD) iterates with some gradient iterates that use a …

New convergence results for the scaled gradient projection method

S Bonettini, M Prato - Inverse Problems, 2015 - iopscience.iop.org
The aim of this paper is to deepen the convergence analysis of the scaled gradient
projection (SGP) method, proposed by Bonettini et al in a recent paper for constrained …

Hybrid limited memory gradient projection methods for box-constrained optimization problems

S Crisci, F Porta, V Ruggiero, L Zanni - Computational Optimization and …, 2023 - Springer
Gradient projection methods represent effective tools for solving large-scale constrained
optimization problems thanks to their simple implementation and low computational cost per …

Delayed gradient methods for symmetric and positive definite linear systems

Q Zou, F Magoulès - SIAM Review, 2022 - SIAM
The primary aim of this paper is to provide a review of the last few decades of research
focused on delayed gradient methods for solving symmetric positive definite linear systems …

Analysis of the Barzilai-Borwein step-sizes for problems in Hilbert spaces

B Azmi, K Kunisch - Journal of Optimization Theory and Applications, 2020 - Springer
Abstract The Barzilai and Borwein gradient method has received a significant amount of
attention in different fields of optimization. This is due to its simplicity, computational …

An efficient gradient method with approximate optimal stepsize for large-scale unconstrained optimization

Z Liu, H Liu - Numerical Algorithms, 2018 - Springer
In this paper, we introduce a new concept of approximate optimal stepsize for gradient
method, use it to interpret the Barzilai-Borwein (BB) method, and present an efficient …

Steplength selection in gradient projection methods for box-constrained quadratic programs

S Crisci, V Ruggiero, L Zanni - Applied Mathematics and Computation, 2019 - Elsevier
The role of the steplength selection strategies in gradient methods has been widely
investigated in the last decades. Starting from the work of Barzilai and Borwein (1988), many …