A Family of Trust Region Based Algorithms for Unconstrained Minimization with Strong Global Convergence Properties.

Author(s):  
Gerald A. Shultz ◽  
Robert B. Schnabel ◽  
Richard H. Byrd
2019 ◽  
Vol 2019 ◽  
pp. 1-10
Author(s):  
Ningning Li ◽  
Dan Xue ◽  
Wenyu Sun ◽  
Jing Wang

In this paper, a stochastic trust region method is proposed to solve unconstrained minimization problems with stochastic objectives. Particularly, this method can be used to deal with nonconvex problems. At each iteration, we construct a quadratic model of the objective function. In the model, stochastic gradient is used to take the place of deterministic gradient for both the determination of descent directions and the approximation of the Hessians of the objective function. The behavior and the convergence properties of the proposed method are discussed under some reasonable conditions. Some preliminary numerical results show that our method is potentially efficient.


2003 ◽  
Vol 44 (4) ◽  
pp. 595-607 ◽  
Author(s):  
Y. F. Yang

AbstractWe propose a new trust region algorithm for solving the system of nonsmooth equations F(x) = 0 by using a smooth function satisfying the Jacobian consistency property to approximate the nonsmooth function F(x). Compared with existing trust region methods for systems of nonsmooth equations, the proposed algorithm possesses some nice convergence properties. Global convergence is established and, in particular, locally superlinear or quadratical convergence is obtained if F is semismooth or strongly semismooth at the solution.


Mathematics ◽  
2021 ◽  
Vol 9 (13) ◽  
pp. 1551
Author(s):  
Bothina El-Sobky ◽  
Yousria Abo-Elnaga ◽  
Abd Allah A. Mousa ◽  
Mohamed A. El-Shorbagy

In this paper, a penalty method is used together with a barrier method to transform a constrained nonlinear programming problem into an unconstrained nonlinear programming problem. In the proposed approach, Newton’s method is applied to the barrier Karush–Kuhn–Tucker conditions. To ensure global convergence from any starting point, a trust-region globalization strategy is used. A global convergence theory of the penalty–barrier trust-region (PBTR) algorithm is studied under four standard assumptions. The PBTR has new features; it is simpler, has rapid convergerce, and is easy to implement. Numerical simulation was performed on some benchmark problems. The proposed algorithm was implemented to find the optimal design of a canal section for minimum water loss for a triangle cross-section application. The results are promising when compared with well-known algorithms.


Sign in / Sign up

Export Citation Format

Share Document