Biased stochastic conjugate gradient algorithm with adaptive step size for nonconvex problems

R Huang, Y Qin, K Liu, G Yuan - Expert Systems with Applications, 2024 - Elsevier
Conjugate gradient (CG) algorithms are widely applied to machine learning problems owing
to their low calculation cost compared with second-order methods and better convergence …

[图书][B] Nonlinear conjugate gradient methods for unconstrained optimization

N Andrei - 2020 - Springer
This book is on conjugate gradient methods for unconstrained optimization. The concept of
conjugacy was introduced by Magnus Hestenes and Garrett Birkhoff in 1936 in the context of …

More intelligent and robust estimation of battery state-of-charge with an improved regularized extreme learning machine

M Jiao, D Wang, Y Yang, F Liu - Engineering Applications of Artificial …, 2021 - Elsevier
Abstract State-of-charge (SOC) is the key parameter for battery management, and the
accurate estimation of SOC is pretty important for the safe and stable operation of lithium …

A conjugate gradient algorithm for large-scale nonlinear equations and image restoration problems

G Yuan, T Li, W Hu - Applied numerical mathematics, 2020 - Elsevier
Nonlinear systems present a quite complicate problem. As the number of dimensions
increases, it becomes more difficult to find the solution of the problem. In this paper, a …

Nonlinear conjugate gradient methods

YH Dai - Wiley Encyclopedia of Operations Research and …, 2010 - Wiley Online Library
Conjugate gradient methods are a class of important methods for solving linear equations
and for solving nonlinear optimization. In this article, a review on conjugate gradient …

Global convergence of a modified Fletcher–Reeves conjugate gradient method with Armijo-type line search

L Zhang, W Zhou, D Li - Numerische mathematik, 2006 - Springer
In this paper, we are concerned with the conjugate gradient methods for solving
unconstrained optimization problems. It is well-known that the direction generated by a …

The global convergence of spectral RMIL conjugate gradient method for unconstrained optimization with applications to robotic model and image recovery

N Salihu, P Kumam, AM Awwal, IM Sulaiman… - Plos one, 2023 - journals.plos.org
In 2012, Rivaie et al. introduced RMIL conjugate gradient (CG) method which is globally
convergent under the exact line search. Later, Dai (2016) pointed out abnormality in the …

A new class of nonlinear conjugate gradient coefficients with global convergence properties

M Rivaie, M Mamat, LW June, I Mohd - Applied Mathematics and …, 2012 - Elsevier
Nonlinear conjugate gradient (CG) methods have played an important role in solving large-
scale unconstrained optimization. Their wide application in many fields is due to their low …

A recalling-enhanced recurrent neural network: Conjugate gradient learning algorithm and its convergence analysis

T Gao, X Gong, K Zhang, F Lin, J Wang, T Huang… - Information …, 2020 - Elsevier
Elman network is a classical recurrent neural network with an internal delay feedback. In this
paper, we propose a recalling-enhanced recurrent neural network (RERNN) which has a …

Scaled conjugate gradient algorithms for unconstrained optimization

N Andrei - Computational Optimization and Applications, 2007 - Springer
In this work we present and analyze a new scaled conjugate gradient algorithm and its
implementation, based on an interpretation of the secant equation and on the inexact Wolfe …