Two Classes of Conjugate Gradient Methods for Large-Scale Unconstrained Optimization

2011 ◽  
Author(s):  
Ming-yuan Cao ◽  
Yue-ting Yang
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Large Scale Unconstrained Optimization

scholarly journals Several Guaranteed Descent Conjugate Gradient Methods for Unconstrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-14
Author(s):  
San-Yang Liu ◽  
Yuan-Yuan Huang
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Line Search ◽  
Gradient Methods ◽  
Numerical Results ◽  
Conjugate Gradient Methods ◽  
Descent Condition ◽  
Wolfe Line Search ◽  
Large Scale Unconstrained Optimization

This paper investigates a general form of guaranteed descent conjugate gradient methods which satisfies the descent conditiongkTdk≤-1-1/4θkgk2  θk>1/4and which is strongly convergent whenever the weak Wolfe line search is fulfilled. Moreover, we present several specific guaranteed descent conjugate gradient methods and give their numerical results for large-scale unconstrained optimization.

scholarly journals The Hybrid BFGS-CG Method in Solving Unconstrained Optimization Problems

2014 ◽  
Vol 2014 ◽  
pp. 1-6 ◽  
Author(s):  
Mohd Asrul Hery Ibrahim ◽  
Mustafa Mamat ◽  
Wah June Leong
Keyword(s):  
Unconstrained Optimization ◽  
Hybrid Method ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Unconstrained Optimization Problems ◽  
Large Scale Unconstrained Optimization ◽  
Quasi Newton

In solving large scale problems, the quasi-Newton method is known as the most efficient method in solving unconstrained optimization problems. Hence, a new hybrid method, known as the BFGS-CG method, has been created based on these properties, combining the search direction between conjugate gradient methods and quasi-Newton methods. In comparison to standard BFGS methods and conjugate gradient methods, the BFGS-CG method shows significant improvement in the total number of iterations and CPU time required to solve large scale unconstrained optimization problems. We also prove that the hybrid method is globally convergent.

scholarly journals Two-versions of descent conjugate gradient methods for large-scale unconstrained optimization

2021 ◽  
Vol 22 (3) ◽  
pp. 1643
Author(s):  
Hawraz N. Jabbar ◽  
Basim A. Hassan
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Taylor Series Expansion ◽  
Conjugate Gradient Methods ◽  
Unconstrained Optimization Problems ◽  
Gradient Type ◽  
Large Scale Unconstrained Optimization

<p>The conjugate gradient methods are noted to be exceedingly valuable for solving large-scale unconstrained optimization problems since it needn't the storage of matrices. Mostly the parameter conjugate is the focus for conjugate gradient methods. The current paper proposes new methods of parameter of conjugate gradient type to solve problems of large-scale unconstrained optimization. A Hessian approximation in a diagonal matrix form on the basis of second and third-order Taylor series expansion was employed in this study. The sufficient descent property for the proposed algorithm are proved. The new method was converged globally. This new algorithm is found to be competitive to the algorithm of fletcher-reeves (FR) in a number of numerical experiments.</p>

scholarly journals Nonlinear Conjugate Gradient Methods with Sufficient Descent Condition for Large-Scale Unconstrained Optimization

2009 ◽  
Vol 2009 ◽  
pp. 1-16 ◽  
Author(s):  
Jianguo Zhang ◽  
Yunhai Xiao ◽  
Zengxin Wei
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Sufficient Descent Condition ◽  
Convergence Results ◽  
Nonlinear Conjugate Gradient ◽  
Large Scale Unconstrained Optimization ◽  
Nonlinear Conjugate Gradient Methods

Two nonlinear conjugate gradient-type methods for solving unconstrained optimization problems are proposed. An attractive property of the methods, is that, without any line search, the generated directions always descend. Under some mild conditions, global convergence results for both methods are established. Preliminary numerical results show that these proposed methods are promising, and competitive with the well-known PRP method.

scholarly journals Two New Conjugate Gradient Methods for Unconstrained Optimization

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-13
Author(s):  
Meixing Liu ◽  
Guodong Ma ◽  
Jianghua Yin
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Line Search ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Globally Convergent ◽  
Sufficient Descent ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

The conjugate gradient method is very effective in solving large-scale unconstrained optimal problems. In this paper, on the basis of the conjugate parameter of the conjugate descent (CD) method and the second inequality in the strong Wolfe line search, two new conjugate parameters are devised. Using the strong Wolfe line search to obtain the step lengths, two modified conjugate gradient methods are proposed for general unconstrained optimization. Under the standard assumptions, the two presented methods are proved to be sufficient descent and globally convergent. Finally, preliminary numerical results are reported to show that the proposed methods are promising.

scholarly journals A Modified Hybrid Conjugate Gradient Method for Unconstrained Optimization

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Minglei Fang ◽  
Min Wang ◽  
Min Sun ◽  
Rong Chen
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient Method ◽  
Conjugate Gradient ◽  
Gradient Method ◽  
Large Scale ◽  
Line Search ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Hybrid Conjugate Gradient Method ◽  
Large Scale Unconstrained Optimization

The nonlinear conjugate gradient algorithms are a very effective way in solving large-scale unconstrained optimization problems. Based on some famous previous conjugate gradient methods, a modified hybrid conjugate gradient method was proposed. The proposed method can generate decent directions at every iteration independent of any line search. Under the Wolfe line search, the proposed method possesses global convergence. Numerical results show that the modified method is efficient and robust.

Sign in / Sign up

Export Citation Format

Share Document