An adaptive nonmonotone trust region method based on a modified scalar approximation of the Hessian in the successive quadratic subproblems

2019 ◽  
Vol 53 (3) ◽  
pp. 829-839
Author(s):  
Saeed Rezaee ◽  
Saman Babaie-Kafaki
Keyword(s):  
Numerical Experiments ◽  
Trust Region Method ◽  
Trust Region ◽  
Quadratic Model ◽  
Test Problems ◽  
Trust Region Subproblem ◽  
Trust Region Algorithm ◽  
Scalar Approximation ◽  
Secant Equation ◽  
Modified Secant Equation

Based on a modified secant equation, we propose a scalar approximation of the Hessian to be used in the trust region subproblem. Then, we suggest an adaptive nonmonotone trust region algorithm with a simple quadratic model. Under proper conditions, it is briefly shown that the proposed algorithm is globally and locally superlinearly convergent. Numerical experiments are done on a set of unconstrained optimization test problems of the CUTEr collection, using the Dolan-Moré performance profile. They demonstrate efficiency of the proposed algorithm.

scholarly journals A Newton-Like Trust Region Method for Large-Scale Unconstrained Nonconvex Minimization

2013 ◽  
Vol 2013 ◽  
pp. 1-6 ◽  
Author(s):  
Yang Weiwei ◽  
Yang Yueting ◽  
Zhang Chenhui ◽  
Cao Mingyuan
Keyword(s):  
Large Scale ◽  
Trust Region Method ◽  
Trust Region ◽  
Test Problems ◽  
Nonconvex Minimization ◽  
Trust Region Subproblem ◽  
Newton Equation ◽  
Limited Memory ◽  
Quasi Newton ◽  
Approximate Hessian

We present a new Newton-like method for large-scale unconstrained nonconvex minimization. And a new straightforward limited memory quasi-Newton updating based on the modified quasi-Newton equation is deduced to construct the trust region subproblem, in which the information of both the function value and gradient is used to construct approximate Hessian. The global convergence of the algorithm is proved. Numerical results indicate that the proposed method is competitive and efficient on some classical large-scale nonconvex test problems.

scholarly journals A Nonmonotone Weighting Self-Adaptive Trust Region Algorithm for Unconstrained Nonconvex Optimization

2015 ◽  
Vol 2015 ◽  
pp. 1-8
Author(s):  
Yunlong Lu ◽  
Weiwei Yang ◽  
Wenyu Li ◽  
Xiaowei Jiang ◽  
Yueting Yang
Keyword(s):  
Nonconvex Optimization ◽  
Line Search ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Search Technique ◽  
Trust Region Algorithm ◽  
Unconstrained Optimization Problems ◽  
Line Search Technique ◽  
Self Adaptive

A new trust region method is presented, which combines nonmonotone line search technique, a self-adaptive update rule for the trust region radius, and the weighting technique for the ratio between the actual reduction and the predicted reduction. Under reasonable assumptions, the global convergence of the method is established for unconstrained nonconvex optimization. Numerical results show that the new method is efficient and robust for solving unconstrained optimization problems.

scholarly journals A randomized adaptive trust region line search method

2020 ◽  
Vol 10 (2) ◽  
pp. 259-263
Author(s):  
Saman Babaie-Kafaki ◽  
Saeed Rezaee
Keyword(s):  
Simulated Annealing ◽  
Numerical Experiments ◽  
Line Search ◽  
Optimization Problems ◽  
Trust Region ◽  
Search Method ◽  
Test Problems ◽  
Unconstrained Optimization Problems ◽  
Line Search Method ◽  
Region Line

Hybridizing the trust region, line search and simulated annealing methods, we develop a heuristic algorithm for solving unconstrained optimization problems. We make some numerical experiments on a set of CUTEr test problems to investigate efficiency of the suggested algorithm. The results show that the algorithm is practically promising.

Parameterize the Center of the Trust Region for Solving Quadratic Interpolation Models

2011 ◽  
Vol 52-54 ◽  
pp. 920-925
Author(s):  
Qing Hua Zhou ◽  
Yan Geng ◽  
Ya Rui Zhang ◽  
Feng Xia Xu
Keyword(s):  
Optimization Problems ◽  
Trust Region Method ◽  
Main Idea ◽  
Trust Region ◽  
Search Region ◽  
Trust Region Algorithm ◽  
Unconstrained Optimization Problems ◽  
Simplex Search ◽  
Quadratic Interpolation ◽  
Derivative Free

The derivative free trust region algorithm was considered for solving the unconstrained optimization problems. This paper introduces a novel methodology that modified the center of the trust region in order to improve the search region. The main idea is parameterizing the center of the trust region based on the ideas of multi-directional search and simplex search algorithms. The scope of the new region was so expanded by introducing a parameter as to we can find a better descent directions. Experimental results reveal that the new method is more effective than the classic trust region method on the testing problems.

A randomized nonmonotone adaptive trust region method based on the simulated annealing strategy for unconstrained optimization

2019 ◽  
Vol 12 (3) ◽  
pp. 389-399
Author(s):  
Saman Babaie-Kafaki ◽  
Saeed Rezaee
Keyword(s):  
Simulated Annealing ◽  
Unconstrained Optimization ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Test Problems ◽  
Content Type ◽  
Unconstrained Optimization Problems ◽  
Randomization Scheme ◽  
Enhance Efficiency

PurposeThe purpose of this paper is to employ stochastic techniques to increase efficiency of the classical algorithms for solving nonlinear optimization problems.Design/methodology/approachThe well-known simulated annealing strategy is employed to search successive neighborhoods of the classical trust region (TR) algorithm.FindingsAn adaptive formula for computing the TR radius is suggested based on an eigenvalue analysis conducted on the memoryless Broyden-Fletcher-Goldfarb-Shanno updating formula. Also, a (heuristic) randomized adaptive TR algorithm is developed for solving unconstrained optimization problems. Results of computational experiments on a set of CUTEr test problems show that the proposed randomization scheme can enhance efficiency of the TR methods.Practical implicationsThe algorithm can be effectively used for solving the optimization problems which appear in engineering, economics, management, industry and other areas.Originality/valueThe proposed randomization scheme improves computational costs of the classical TR algorithm. Especially, the suggested algorithm avoids resolving the TR subproblems for many times.

scholarly journals A Simple Alternating Direction Method for the Conic Trust Region Subproblem

2018 ◽  
Vol 2018 ◽  
pp. 1-9
Author(s):  
Honglan Zhu ◽  
Qin Ni
Keyword(s):  
Trust Region ◽  
Alternating Direction Method ◽  
New Method ◽  
Quadratic Model ◽  
Descent Direction ◽  
Orthogonal Direction ◽  
Trust Region Subproblem ◽  
One Dimensional ◽  
Alternating Direction ◽  
Low Dimensional

A simple alternating direction method is used to solve the conic trust region subproblem of unconstrained optimization. By use of the new method, the subproblem is solved by two steps in a descent direction and its orthogonal direction, the original conic trust domain subproblem into a one-dimensional subproblem and a low-dimensional quadratic model subproblem, both of which are very easy to solve. Then the global convergence of the method under some reasonable conditions is established. Numerical experiment shows that the new method seems simple and effective.

scholarly journals A Novel Self-Adaptive Trust Region Algorithm for Unconstrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Yunlong Lu ◽  
Wenyu Li ◽  
Mingyuan Cao ◽  
Yueting Yang
Keyword(s):  
Objective Function ◽  
Unconstrained Optimization ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Convergence Properties ◽  
Trust Region Algorithm ◽  
Unconstrained Optimization Problems ◽  
Piecewise Function ◽  
Self Adaptive

A new self-adaptive rule of trust region radius is introduced, which is given by a piecewise function on the ratio between the actual and predicted reductions of the objective function. A self-adaptive trust region method for unconstrained optimization problems is presented. The convergence properties of the method are established under reasonable assumptions. Preliminary numerical results show that the new method is significant and robust for solving unconstrained optimization problems.

A Note on Wedge Trust Region Radius Update

2011 ◽  
Vol 52-54 ◽  
pp. 926-931
Author(s):  
Qing Hua Zhou ◽  
Feng Xia Xu ◽  
Yan Geng ◽  
Ya Rui Zhang
Keyword(s):  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Test Problems ◽  
Region Method ◽  
Derivative Free Optimization ◽  
Derivative Free ◽  
Updating Rule

Wedge trust region method based on traditional trust region is designed for derivative free optimization problems. This method adds a constraint to the trust region problem, which is called “wedge method”. The problem is that the updating strategy of wedge trust region radius is somewhat simple. In this paper, we develop and combine a new radius updating rule with this method. For most test problems, the number of function evaluations is reduced significantly. The experiments demonstrate the effectiveness of the improvement through our algorithm.

scholarly journals AN IMPROVED ADAPTIVE TRUST-REGION METHOD FOR UNCONSTRAINED OPTIMIZATION

2014 ◽  
Vol 19 (4) ◽  
pp. 469-490 ◽  
Author(s):  
Hamid Esmaeili ◽  
Morteza Kimiaei
Keyword(s):  
Unconstrained Optimization ◽  
Large Scale ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Standard Test ◽  
Test Problems ◽  
Unconstrained Optimization Problems ◽  
Large Scale Problems ◽  
Adaptive Radius

In this study, we propose a trust-region-based procedure to solve unconstrained optimization problems that take advantage of the nonmonotone technique to introduce an efficient adaptive radius strategy. In our approach, the adaptive technique leads to decreasing the total number of iterations, while utilizing the structure of nonmonotone formula helps us to handle large-scale problems. The new algorithm preserves the global convergence and has quadratic convergence under suitable conditions. Preliminary numerical experiments on standard test problems indicate the efficiency and robustness of the proposed approach for solving unconstrained optimization problems.

Sign in / Sign up

Export Citation Format

Share Document