scholarly journals Several Guaranteed Descent Conjugate Gradient Methods for Unconstrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-14
Author(s):  
San-Yang Liu ◽  
Yuan-Yuan Huang
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Line Search ◽  
Gradient Methods ◽  
Numerical Results ◽  
Conjugate Gradient Methods ◽  
Descent Condition ◽  
Wolfe Line Search ◽  
Large Scale Unconstrained Optimization

This paper investigates a general form of guaranteed descent conjugate gradient methods which satisfies the descent conditiongkTdk≤-1-1/4θkgk2  θk>1/4and which is strongly convergent whenever the weak Wolfe line search is fulfilled. Moreover, we present several specific guaranteed descent conjugate gradient methods and give their numerical results for large-scale unconstrained optimization.

scholarly journals Two New Conjugate Gradient Methods for Unconstrained Optimization

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-13
Author(s):  
Meixing Liu ◽  
Guodong Ma ◽  
Jianghua Yin
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Line Search ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Globally Convergent ◽  
Sufficient Descent ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

The conjugate gradient method is very effective in solving large-scale unconstrained optimal problems. In this paper, on the basis of the conjugate parameter of the conjugate descent (CD) method and the second inequality in the strong Wolfe line search, two new conjugate parameters are devised. Using the strong Wolfe line search to obtain the step lengths, two modified conjugate gradient methods are proposed for general unconstrained optimization. Under the standard assumptions, the two presented methods are proved to be sufficient descent and globally convergent. Finally, preliminary numerical results are reported to show that the proposed methods are promising.

scholarly journals A Modified Hybrid Conjugate Gradient Method for Unconstrained Optimization

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Minglei Fang ◽  
Min Wang ◽  
Min Sun ◽  
Rong Chen
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient Method ◽  
Conjugate Gradient ◽  
Gradient Method ◽  
Large Scale ◽  
Line Search ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Hybrid Conjugate Gradient Method ◽  
Large Scale Unconstrained Optimization

The nonlinear conjugate gradient algorithms are a very effective way in solving large-scale unconstrained optimization problems. Based on some famous previous conjugate gradient methods, a modified hybrid conjugate gradient method was proposed. The proposed method can generate decent directions at every iteration independent of any line search. Under the Wolfe line search, the proposed method possesses global convergence. Numerical results show that the modified method is efficient and robust.

scholarly journals The Hybrid BFGS-CG Method in Solving Unconstrained Optimization Problems

2014 ◽  
Vol 2014 ◽  
pp. 1-6 ◽  
Author(s):  
Mohd Asrul Hery Ibrahim ◽  
Mustafa Mamat ◽  
Wah June Leong
Keyword(s):  
Unconstrained Optimization ◽  
Hybrid Method ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Unconstrained Optimization Problems ◽  
Large Scale Unconstrained Optimization ◽  
Quasi Newton

In solving large scale problems, the quasi-Newton method is known as the most efficient method in solving unconstrained optimization problems. Hence, a new hybrid method, known as the BFGS-CG method, has been created based on these properties, combining the search direction between conjugate gradient methods and quasi-Newton methods. In comparison to standard BFGS methods and conjugate gradient methods, the BFGS-CG method shows significant improvement in the total number of iterations and CPU time required to solve large scale unconstrained optimization problems. We also prove that the hybrid method is globally convergent.

scholarly journals Two-versions of descent conjugate gradient methods for large-scale unconstrained optimization

2021 ◽  
Vol 22 (3) ◽  
pp. 1643
Author(s):  
Hawraz N. Jabbar ◽  
Basim A. Hassan
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Taylor Series Expansion ◽  
Conjugate Gradient Methods ◽  
Unconstrained Optimization Problems ◽  
Gradient Type ◽  
Large Scale Unconstrained Optimization

<p>The conjugate gradient methods are noted to be exceedingly valuable for solving large-scale unconstrained optimization problems since it needn't the storage of matrices. Mostly the parameter conjugate is the focus for conjugate gradient methods. The current paper proposes new methods of parameter of conjugate gradient type to solve problems of large-scale unconstrained optimization. A Hessian approximation in a diagonal matrix form on the basis of second and third-order Taylor series expansion was employed in this study. The sufficient descent property for the proposed algorithm are proved. The new method was converged globally. This new algorithm is found to be competitive to the algorithm of fletcher-reeves (FR) in a number of numerical experiments.</p>

scholarly journals Some generalized three-term conjugate gradient methods based on CD approach for unconstrained optimization problems

2021 ◽  
Vol 3 (2) ◽  
pp. 67-82
Author(s):  
Ladan Arman ◽  
Yuanming Xu ◽  
Long Liping
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Line Search ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Sufficient Descent Condition ◽  
Unconstrained Optimization Problems ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

Abstract In this paper, based on the efficient Conjugate Descent (CD) method, two generalized CD algorithms are proposed to solve the unconstrained optimization problems. These methods are three-term conjugate gradient methods which the generated directions by using the conjugate gradient parameters and independent of the line search satisfy in the sufficient descent condition. Furthermore, under the strong Wolfe line search, the global convergence of the proposed methods are proved. Also, the preliminary numerical results on the CUTEst collection are presented to show effectiveness of our methods.

Sign in / Sign up

Export Citation Format

Share Document