scholarly journals A Limited Memory Algorithm for Bound Constrained Optimization

1995 ◽  
Vol 16 (5) ◽  
pp. 1190-1208 ◽  
Author(s):  
Richard H. Byrd ◽  
Peihuang Lu ◽  
Jorge Nocedal ◽  
Ciyou Zhu
Keyword(s):  
Constrained Optimization ◽  
Limited Memory ◽  
Bound Constrained Optimization

scholarly journals LMBOPT: a limited memory method for bound-constrained optimization

2022 ◽  
Author(s):  
Morteza Kimiaei ◽  
Arnold Neumaier ◽  
Behzad Azmi
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
Piecewise Linear ◽  
Convergence Theory ◽  
Active Set ◽  
Limited Memory ◽  
Constrained Problems ◽  
Problem Class ◽  
Bound Constrained Optimization ◽  
Problem Dimension

AbstractRecently, Neumaier and Azmi gave a comprehensive convergence theory for a generic algorithm for bound constrained optimization problems with a continuously differentiable objective function. The algorithm combines an active set strategy with a gradient-free line search along a piecewise linear search path defined by directions chosen to reduce zigzagging. This paper describes , an efficient implementation of this scheme. It employs new limited memory techniques for computing the search directions, improves by adding various safeguards relevant when finite precision arithmetic is used, and adds many practical enhancements in other details. The paper compares and several other solvers on the unconstrained and bound constrained problems from the collection and makes recommendations on which solver to use and when. Depending on the problem class, the problem dimension, and the precise goal, the best solvers are , , and .

scholarly journals An Active Set Trust-Region Method for Bound-Constrained Optimization

2021 ◽  
Author(s):  
Morteza Kimiaei
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Positive Definiteness ◽  
Active Set ◽  
Sufficient Descent Condition ◽  
Critical Measure ◽  
Complexity Result ◽  
Bound Constrained Optimization

AbstractThis paper discusses an active set trust-region algorithm for bound-constrained optimization problems. A sufficient descent condition is used as a computational measure to identify whether the function value is reduced or not. To get our complexity result, a critical measure is used which is computationally better than the other known critical measures. Under the positive definiteness of approximated Hessian matrices restricted to the subspace of non-active variables, it will be shown that unlimited zigzagging cannot occur. It is shown that our algorithm is competitive in comparison with the state-of-the-art solvers for solving an ill-conditioned bound-constrained least-squares problem.

Sign in / Sign up

Export Citation Format

Share Document