Trust Region Based MPS Method for Global Optimization of High Dimensional Design Problems

2012 ◽  
Author(s):  
George Cheng ◽  
Gaofeng Wang
Keyword(s):  
Global Optimization ◽  
Trust Region ◽  
High Dimensional ◽  
Design Problems ◽  
Mps Method

Trust Region Based Mode Pursuing Sampling Method for Global Optimization of High Dimensional Design Problems

2015 ◽  
Vol 137 (2) ◽  
Author(s):  
George H. Cheng ◽  
Adel Younis ◽  
Kambiz Haji Hajikolaei ◽  
G. Gary Wang
Keyword(s):  
Global Optimization ◽  
Optimization Problems ◽  
Trust Region ◽  
Standard Test ◽  
Black Box ◽  
High Dimensional ◽  
Efficient Global Optimization ◽  
Test Problems ◽  
Design Problems ◽  
Design Variables

Mode pursuing sampling (MPS) was developed as a global optimization algorithm for design optimization problems involving expensive black box functions. MPS has been found to be effective and efficient for design problems of low dimensionality, i.e., the number of design variables is less than 10. This work integrates the concept of trust regions into the MPS framework to create a new algorithm, trust region based mode pursuing sampling (TRMPS2), with the aim of dramatically improving performance and efficiency for high dimensional problems. TRMPS2 is benchmarked against genetic algorithm (GA), dividing rectangles (DIRECT), efficient global optimization (EGO), and MPS using a suite of standard test problems and an engineering design problem. The results show that TRMPS2 performs better on average than GA, DIRECT, EGO, and MPS for high dimensional, expensive, and black box (HEB) problems.

Salp swarm algorithm with crossover scheme and Lévy flight for global optimization

2021 ◽  
pp. 1-12
Author(s):  
Heming Jia ◽  
Chunbo Lang
Keyword(s):  
Global Optimization ◽  
Heuristic Algorithm ◽  
Experimental Results ◽  
High Dimensional ◽  
Lévy Flight ◽  
Test Functions ◽  
Levy Flight ◽  
Salp Swarm Algorithm ◽  
Swarm Algorithm ◽  
Accuracy And Stability

Salp swarm algorithm (SSA) is a meta-heuristic algorithm proposed in recent years, which shows certain advantages in solving some optimization tasks. However, with the increasing difficulty of solving the problem (e.g. multi-modal, high-dimensional), the convergence accuracy and stability of SSA algorithm decrease. In order to overcome the drawbacks, salp swarm algorithm with crossover scheme and Lévy flight (SSACL) is proposed. The crossover scheme and Lévy flight strategy are used to improve the movement patterns of salp leader and followers, respectively. Experiments have been conducted on various test functions, including unimodal, multimodal, and composite functions. The experimental results indicate that the proposed SSACL algorithm outperforms other advanced algorithms in terms of precision, stability, and efficiency. Furthermore, the Wilcoxon’s rank sum test illustrates the advantages of proposed method in a statistical and meaningful way.

scholarly journals Investigation of Improved Cooperative Coevolution for Large-Scale Global Optimization Problems

Algorithms ◽  
2021 ◽  
Vol 14 (5) ◽  
pp. 146
Author(s):  
Aleksei Vakhnin ◽  
Evgenii Sopov
Keyword(s):  
Global Optimization ◽  
Evolutionary Algorithms ◽  
Numerical Experiments ◽  
Large Scale ◽  
Optimization Problems ◽  
State Of The Art ◽  
Fixed Number ◽  
High Dimensional ◽  
Cooperative Coevolution ◽  
Large Scale Problems

Modern real-valued optimization problems are complex and high-dimensional, and they are known as “large-scale global optimization (LSGO)” problems. Classic evolutionary algorithms (EAs) perform poorly on this class of problems because of the curse of dimensionality. Cooperative Coevolution (CC) is a high-performed framework for performing the decomposition of large-scale problems into smaller and easier subproblems by grouping objective variables. The efficiency of CC strongly depends on the size of groups and the grouping approach. In this study, an improved CC (iCC) approach for solving LSGO problems has been proposed and investigated. iCC changes the number of variables in subcomponents dynamically during the optimization process. The SHADE algorithm is used as a subcomponent optimizer. We have investigated the performance of iCC-SHADE and CC-SHADE on fifteen problems from the LSGO CEC’13 benchmark set provided by the IEEE Congress of Evolutionary Computation. The results of numerical experiments have shown that iCC-SHADE outperforms, on average, CC-SHADE with a fixed number of subcomponents. Also, we have compared iCC-SHADE with some state-of-the-art LSGO metaheuristics. The experimental results have shown that the proposed algorithm is competitive with other efficient metaheuristics.

Multiobjective Optimization for High Dimensional Expensively Constrained Black-Box Problems

2021 ◽  
pp. 1-59
Author(s):  
George Cheng ◽  
G. Gary Wang ◽  
Yeong-Maw Hwang
Keyword(s):  
Multiobjective Optimization ◽  
Trust Region ◽  
Adaptive Strategy ◽  
Black Box ◽  
Superior Performance ◽  
High Dimensional ◽  
Multi Objective Optimization ◽  
Semiconductor Substrate ◽  
Multi Objective ◽  
Computationally Expensive

Abstract Multi-objective optimization (MOO) problems with computationally expensive constraints are commonly seen in real-world engineering design. However, metamodel based design optimization (MBDO) approaches for MOO are often not suitable for high-dimensional problems and often do not support expensive constraints. In this work, the Situational Adaptive Kreisselmeier and Steinhauser (SAKS) method was combined with a new multi-objective trust region optimizer (MTRO) strategy to form the SAKS-MTRO method for MOO problems with expensive black-box constraint functions. The SAKS method is an approach that hybridizes the modeling and aggregation of expensive constraints and adds an adaptive strategy to control the level of hybridization. The MTRO strategy uses a combination of objective decomposition and K-means clustering to handle MOO problems. SAKS-MTRO was benchmarked against four popular multi-objective optimizers and demonstrated superior performance on average. SAKS-MTRO was also applied to optimize the design of a semiconductor substrate and the design of an industrial recessed impeller.

Improved Trust Region Based MPS Method for High-Dimensional Expensive Black-Box Problems

2013 ◽  
Author(s):  
George H. Cheng ◽  
Adel Younis ◽  
Kambiz Haji Hajikolaei ◽  
G. Gary Wang
Keyword(s):  
Optimization Problems ◽  
Trust Region ◽  
Black Box ◽  
High Dimensional ◽  
Test Problems ◽  
Design Variables ◽  
Low Dimensionality ◽  
Improve Algorithm ◽  
Improved Performance ◽  
Better Than

Mode Pursuing Sampling (MPS) was developed as a global optimization algorithm for optimization problems involving expensive black box functions. MPS has been found to be effective and efficient for problems of low dimensionality, i.e., the number of design variables is less than ten. A previous conference publication integrated the concept of trust regions into the MPS framework to create a new algorithm, TRMPS, which dramatically improved performance and efficiency for high dimensional problems. However, although TRMPS performed better than MPS, it was unproven against other established algorithms such as GA. This paper introduces an improved algorithm, TRMPS2, which incorporates guided sampling and low function value criterion to further improve algorithm performance for high dimensional problems. TRMPS2 is benchmarked against MPS and GA using a suite of test problems. The results show that TRMPS2 performs better than MPS and GA on average for high dimensional, expensive, and black box (HEB) problems.

scholarly journals Adaptive Response Surface Method Using Inherited Latin Hypercube Design Points

2003 ◽  
Vol 125 (2) ◽  
pp. 210-220 ◽  
Author(s):  
G. Gary Wang
Keyword(s):  
Response Surface ◽  
Response Surface Method ◽  
Adaptive Response ◽  
High Dimensional ◽  
Latin Hypercube Design ◽  
Latin Hypercube ◽  
Design Problems ◽  
Surface Method ◽  
Adaptive Response Surface Method ◽  
Design Experiments

This paper addresses the difficulty of the previously developed Adaptive Response Surface Method (ARSM) for high-dimensional design problems. ARSM was developed to search for the global design optimum for computation-intensive design problems. This method utilizes Central Composite Design (CCD), which results in an exponentially increasing number of required design experiments. In addition, ARSM generates a complete new set of CCD points in a gradually reduced design space. These two factors greatly undermine the efficiency of ARSM. In this work, Latin Hypercube Design (LHD) is utilized to generate saturated design experiments. Because of the use of LHD, historical design experiments can be inherited in later iterations. As a result, ARSM only requires a limited number of design experiments even for high-dimensional design problems. The improved ARSM is tested using a group of standard test problems and then applied to an engineering design problem. In both testing and design application, significant improvement in the efficiency of ARSM is realized. The improved ARSM demonstrates strong potential to be a practical global optimization tool for computation-intensive design problems. Inheriting LHD points, as a general sampling strategy, can be integrated into other approximation-based design optimization methodologies.

scholarly journals Differential Evolution with Novel Mutation and Adaptive Crossover Strategies for Solving Large Scale Global Optimization Problems

2017 ◽  
Vol 2017 ◽  
pp. 1-18 ◽  
Author(s):  
Ali Wagdy Mohamed ◽  
Abdulaziz S. Almazyad
Keyword(s):  
Global Optimization ◽  
Differential Evolution ◽  
Large Scale ◽  
Optimization Problems ◽  
Differential Evolution Algorithm ◽  
High Dimensional ◽  
Gradual Change ◽  
Comparison Results ◽  
Mutation Strategy ◽  
Common Trade

This paper presents Differential Evolution algorithm for solving high-dimensional optimization problems over continuous space. The proposed algorithm, namely, ANDE, introduces a new triangular mutation rule based on the convex combination vector of the triplet defined by the three randomly chosen vectors and the difference vectors between the best, better, and the worst individuals among the three randomly selected vectors. The mutation rule is combined with the basic mutation strategy DE/rand/1/bin, where the new triangular mutation rule is applied with the probability of 2/3 since it has both exploration ability and exploitation tendency. Furthermore, we propose a novel self-adaptive scheme for gradual change of the values of the crossover rate that can excellently benefit from the past experience of the individuals in the search space during evolution process which in turn can considerably balance the common trade-off between the population diversity and convergence speed. The proposed algorithm has been evaluated on the 20 standard high-dimensional benchmark numerical optimization problems for the IEEE CEC-2010 Special Session and Competition on Large Scale Global Optimization. The comparison results between ANDE and its versions and the other seven state-of-the-art evolutionary algorithms that were all tested on this test suite indicate that the proposed algorithm and its two versions are highly competitive algorithms for solving large scale global optimization problems.

Sign in / Sign up

Export Citation Format

Share Document