A modified parallel BFGS method for nonconvex functions

2011 ◽  
Vol 3 (9) ◽  
pp. 210-218
Author(s):  
Ganzhou Wu
Keyword(s):  
Bfgs Method ◽  
Nonconvex Functions

scholarly journals Global Convergence of a Modified Two-Parameter Scaled BFGS Method with Yuan-Wei-Lu Line Search for Unconstrained Optimization

2020 ◽  
Vol 2020 ◽  
pp. 1-15
Author(s):  
Pengyuan Li ◽  
Zhan Wang ◽  
Dan Luo ◽  
Hongtruong Pham
Keyword(s):  
Unconstrained Optimization ◽  
Line Search ◽  
Optimization Problems ◽  
Medium Size ◽  
Bfgs Method ◽  
Nonconvex Functions ◽  
Bfgs Update ◽  
Unconstrained Optimization Problems ◽  
Quasi Newton ◽  
Two Parameter

The BFGS method is one of the most efficient quasi-Newton methods for solving small- and medium-size unconstrained optimization problems. For the sake of exploring its more interesting properties, a modified two-parameter scaled BFGS method is stated in this paper. The intention of the modified scaled BFGS method is to improve the eigenvalues structure of the BFGS update. In this method, the first two terms and the last term of the standard BFGS update formula are scaled with two different positive parameters, and the new value of yk is given. Meanwhile, Yuan-Wei-Lu line search is also proposed. Under the mentioned line search, the modified two-parameter scaled BFGS method is globally convergent for nonconvex functions. The extensive numerical experiments show that this form of the scaled BFGS method outperforms the standard BFGS method or some similar scaled methods.

scholarly journals The global convergence of a modified BFGS method for nonconvex functions

2018 ◽  
Vol 327 ◽  
pp. 274-294 ◽  
Author(s):  
Gonglin Yuan ◽  
Zhou Sheng ◽  
Bopeng Wang ◽  
Wujie Hu ◽  
Chunnian Li
Keyword(s):  
Global Convergence ◽  
Bfgs Method ◽  
Nonconvex Functions

scholarly journals Fractional Integral Inequalities for Exponentially Nonconvex Functions and Their Applications

2021 ◽  
Vol 5 (3) ◽  
pp. 80
Author(s):  
Hari Mohan Srivastava ◽  
Artion Kashuri ◽  
Pshtiwan Othman Mohammed ◽  
Dumitru Baleanu ◽  
Y. S. Hamed
Keyword(s):  
Integral Inequalities ◽  
Fractional Integrals ◽  
Auxiliary Result ◽  
Wright Function ◽  
Nonconvex Functions ◽  
Special Cases ◽  
Type Integral ◽  
Generic Class ◽  
Two Parameters ◽  
Class Of Functions

In this paper, the authors define a new generic class of functions involving a certain modified Fox–Wright function. A useful identity using fractional integrals and this modified Fox–Wright function with two parameters is also found. Applying this as an auxiliary result, we establish some Hermite–Hadamard-type integral inequalities by using the above-mentioned class of functions. Some special cases are derived with relevant details. Moreover, in order to show the efficiency of our main results, an application for error estimation is obtained as well.

scholarly journals A consensus-based global optimization method for high dimensional machine learning problems

2020 ◽  
Author(s):  
Jose Carrillo ◽  
Shi Jin ◽  
Lei Li ◽  
Yuhua Zhu
Keyword(s):  
Optimization Problems ◽  
Computational Cost ◽  
Weighted Average ◽  
Planck Equation ◽  
Optimization Method ◽  
Learning Problems ◽  
High Dimensional ◽  
Nonconvex Functions ◽  
The Individual ◽  
Parameter Constraints

We improve recently introduced consensus-based optimization method, proposed in [R. Pinnau, C. Totzeck, O. Tse and S. Martin, Math. Models Methods Appl. Sci., 27(01):183{204, 2017], which is a gradient-free optimization method for general nonconvex functions. We rst replace the isotropic geometric Brownian motion by the component-wise one, thus removing the dimensionality dependence of the drift rate, making the method more competitive for high dimensional optimization problems. Secondly, we utilize the random mini-batch ideas to reduce the computational cost of calculating the weighted average which the individual particles tend to relax toward. For its mean- eld limit{a nonlinear Fokker-Planck equation{we prove, in both time continuous and semi-discrete settings, that the convergence of the method, which is exponential in time, is guaranteed with parameter constraints independent of the dimensionality. We also conduct numerical tests to high dimensional problems to check the success rate of the method.

Sign in / Sign up

Export Citation Format

Share Document