scholarly journals An Improved Transient Search Optimization with Neighborhood Dimensional Learning for Global Optimization Problems

Symmetry ◽  
2021 ◽  
Vol 13 (2) ◽  
pp. 244
Author(s):  
Wenbiao Yang ◽  
Kewen Xia ◽  
Tiejun Li ◽  
Min Xie ◽  
Yaning Zhao
Keyword(s):  
Learning Strategy ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Transient Behavior ◽  
New Physics ◽  
Population Diversity ◽  
Local Optima ◽  
Switching Circuits ◽  
Search Optimization ◽  
Benchmark Test Functions

The transient search algorithm (TSO) is a new physics-based metaheuristic algorithm that simulates the transient behavior of switching circuits, such as inductors and capacitors, but the algorithm suffers from slow convergence and has a poor ability to circumvent local optima when solving high-dimensional complex problems. To address these drawbacks, an improved transient search algorithm (ITSO) is proposed. Three strategies are introduced to the TSO. First, a chaotic opposition learning strategy is used to generate high-quality initial populations; second, an adaptive inertia weighting strategy is used to improve the exploration ability, exploitation ability, and convergence speed; finally, a neighborhood dimensional learning strategy is used to maintain population diversity with each iteration of merit seeking. The Friedman test and Wilcoxon’s rank sum test were also used by comparing the experiments with recently popular algorithms on 18 benchmark test functions of various types. Statistical results, nonparametric sign tests, and convergence curves all indicate that ITSO develops, explores, and converges significantly better than other popular algorithms, and is a promising intelligent optimization algorithm for applications.

A Strength Pareto Gravitational Search Algorithm for Multi-Objective Optimization Problems

2015 ◽  
Vol 29 (06) ◽  
pp. 1559010 ◽  
Author(s):  
Xiaohui Yuan ◽  
Zhihuan Chen ◽  
Yanbin Yuan ◽  
Yuehua Huang ◽  
Xiaopan Zhang
Keyword(s):  
Optimization Problems ◽  
Search Algorithm ◽  
Gravitational Search Algorithm ◽  
Population Diversity ◽  
Benchmark Problems ◽  
Multi Objective Optimization ◽  
Local Optima ◽  
Multi Objective ◽  
Fine Grained ◽  
Gravitational Search

A novel strength Pareto gravitational search algorithm (SPGSA) is proposed to solve multi-objective optimization problems. This SPGSA algorithm utilizes the strength Pareto concept to assign the fitness values for agents and uses a fine-grained elitism selection mechanism to keep the population diversity. Furthermore, the recombination operators are modeled in this approach to decrease the possibility of trapping in local optima. Experiments are conducted on a series of benchmark problems that are characterized by difficulties in local optimality, nonuniformity, and nonconvexity. The results show that the proposed SPGSA algorithm performs better in comparison with other related works. On the other hand, the effectiveness of two subtle means added to the GSA are verified, i.e. the fine-grained elitism selection and the use of SBX and PMO operators. Simulation results show that these measures not only improve the convergence ability of original GSA, but also preserve the population diversity adequately, which enables the SPGSA algorithm to have an excellent ability that keeps a desirable balance between the exploitation and exploration so as to accelerate the convergence speed to the true Pareto-optimal front.

scholarly journals An Improved Harmony Search Based on Teaching-Learning Strategy for Unconstrained Optimization Problems

2013 ◽  
Vol 2013 ◽  
pp. 1-29 ◽  
Author(s):  
Shouheng Tuo ◽  
Longquan Yong ◽  
Tao Zhou
Keyword(s):  
High Dimension ◽  
Learning Strategy ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Harmony Search ◽  
Population Based ◽  
Population Diversity ◽  
Random Mutation ◽  
Complex Optimization ◽  
Teaching Learning

Harmony search (HS) algorithm is an emerging population-based metaheuristic algorithm, which is inspired by the music improvisation process. The HS method has been developed rapidly and applied widely during the past decade. In this paper, an improved global harmony search algorithm, named harmony search based on teaching-learning (HSTL), is presented for high dimension complex optimization problems. In HSTL algorithm, four strategies (harmony memory consideration, teaching-learning strategy, local pitch adjusting, and random mutation) are employed to maintain the proper balance between convergence and population diversity, and dynamic strategy is adopted to change the parameters. The proposed HSTL algorithm is investigated and compared with three other state-of-the-art HS optimization algorithms. Furthermore, to demonstrate the robustness and convergence, the success rate and convergence analysis is also studied. The experimental results of 31 complex benchmark functions demonstrate that the HSTL method has strong convergence and robustness and has better balance capacity of space exploration and local exploitation on high dimension complex optimization problems.

scholarly journals A Modified Slime Mould Algorithm for Global Optimization

2021 ◽  
Vol 2021 ◽  
pp. 1-22
Author(s):  
An-Di Tang ◽  
Shang-Qin Tang ◽  
Tong Han ◽  
Huan Zhou ◽  
Lei Xie
Keyword(s):  
Learning Strategy ◽  
Optimization Problems ◽  
Control Strategies ◽  
Population Based ◽  
Population Diversity ◽  
Local Optimum ◽  
Test Functions ◽  
Local Optima ◽  
Slime Mould ◽  
Exploitation And Exploration

Slime mould algorithm (SMA) is a population-based metaheuristic algorithm inspired by the phenomenon of slime mould oscillation. The SMA is competitive compared to other algorithms but still suffers from the disadvantages of unbalanced exploitation and exploration and is easy to fall into local optima. To address these shortcomings, an improved variant of SMA named MSMA is proposed in this paper. Firstly, a chaotic opposition-based learning strategy is used to enhance population diversity. Secondly, two adaptive parameter control strategies are proposed to balance exploitation and exploration. Finally, a spiral search strategy is used to help SMA get rid of local optimum. The superiority of MSMA is verified in 13 multidimensional test functions and 10 fixed-dimensional test functions. In addition, two engineering optimization problems are used to verify the potential of MSMA to solve real-world optimization problems. The simulation results show that the proposed MSMA outperforms other comparative algorithms in terms of convergence accuracy, convergence speed, and stability.

Optimizing the Learning Process of Feedforward Neural Networks Using Lightning Search Algorithm

2016 ◽  
Vol 25 (06) ◽  
pp. 1650033 ◽  
Author(s):  
Hossam Faris ◽  
Ibrahim Aljarah ◽  
Nailah Al-Madi ◽  
Seyedali Mirjalili
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Optimization Technique ◽  
Back Propagation ◽  
Feedforward Neural Networks ◽  
Training Algorithms ◽  
Local Optima ◽  
Local Solutions

Evolutionary Neural Networks are proven to be beneficial in solving challenging datasets mainly due to the high local optima avoidance. Stochastic operators in such techniques reduce the probability of stagnation in local solutions and assist them to supersede conventional training algorithms such as Back Propagation (BP) and Levenberg-Marquardt (LM). According to the No-Free-Lunch (NFL), however, there is no optimization technique for solving all optimization problems. This means that a Neural Network trained by a new algorithm has the potential to solve a new set of problems or outperform the current techniques in solving existing problems. This motivates our attempts to investigate the efficiency of the recently proposed Evolutionary Algorithm called Lightning Search Algorithm (LSA) in training Neural Network for the first time in the literature. The LSA-based trainer is benchmarked on 16 popular medical diagnosis problems and compared to BP, LM, and 6 other evolutionary trainers. The quantitative and qualitative results show that the LSA algorithm is able to show not only better local solutions avoidance but also faster convergence speed compared to the other algorithms employed. In addition, the statistical test conducted proves that the LSA-based trainer is significantly superior in comparison with the current algorithms on the majority of datasets.

Improved Hybrid Particle Swarm Optimizer With Sine-Cosine Acceleration Coefficients For Transient Electromagnetic Inversion

2021 ◽  
Vol 16 ◽  
Author(s):  
Ruiheng Li ◽  
Qiong Zhuang ◽  
Nian Yu ◽  
Ruiyou Li ◽  
Huaiqing Zhang
Keyword(s):  
Learning Strategy ◽  
Particle Swarm ◽  
Population Diversity ◽  
Nonlinear Inversion ◽  
Test Functions ◽  
Particle Swarm Optimizer ◽  
Local Optima ◽  
Hybrid Particle ◽  
Transient Electromagnetic ◽  
Stability And Accuracy

Background: Recently, particle swarm optimization (PSO) has been increasingly used in geophysics due to its simple operation and fast convergence. Objective: However, PSO lacks population diversity and may fall to local optima. Hence, an improved hybrid particle swarm optimizer with sine-cosine acceleration coefficients (IH-PSO-SCAC) is proposed and successfully applied to test functions and in transient electromagnetic (TEM) nonlinear inversion. Method: A reverse learning strategy is applied to optimize population initialization. The sine-cosine acceleration coefficients are utilized for global convergence. Sine mapping is adopted to enhance population diversity during the search process. In addition, the mutation method is used to reduce the probability of premature convergence. Results: The application of IH-PSO-SCAC in the test functions and several simple layered models are demonstrated with satisfactory results in terms of data fit. Two inversions have been carried out to test our algorithm. The first model contains an underground low-resistivity anomaly body and the second model utilized measured data from a profile of the Xishan landslide in Sichuan Province. In both cases, resistivity profiles are obtained, and the inverse problem is solved for verification. Conclusion: The results show that the IH-PSO-SCAC algorithm is practical, can be effectively applied in TEM inversion and is superior to other representative algorithms in terms of stability and accuracy.

scholarly journals An improved arithmetic optimization algorithm with forced switching mechanism for global optimization problems

2022 ◽  
Vol 19 (1) ◽  
pp. 473-512
Author(s):  
Rong Zheng ◽  
◽  
Heming Jia ◽  
Laith Abualigah ◽  
Qingxin Liu ◽  
...  
Keyword(s):  
Optimization Algorithm ◽  
Optimization Problems ◽  
Heuristic Method ◽  
Population Diversity ◽  
Test Functions ◽  
Design Problems ◽  
Local Optima ◽  
Switching Mechanism ◽  
Engineering Design Problems

<abstract> <p>Arithmetic optimization algorithm (AOA) is a newly proposed meta-heuristic method which is inspired by the arithmetic operators in mathematics. However, the AOA has the weaknesses of insufficient exploration capability and is likely to fall into local optima. To improve the searching quality of original AOA, this paper presents an improved AOA (IAOA) integrated with proposed forced switching mechanism (FSM). The enhanced algorithm uses the random math optimizer probability (<italic>RMOP</italic>) to increase the population diversity for better global search. And then the forced switching mechanism is introduced into the AOA to help the search agents jump out of the local optima. When the search agents cannot find better positions within a certain number of iterations, the proposed FSM will make them conduct the exploratory behavior. Thus the cases of being trapped into local optima can be avoided effectively. The proposed IAOA is extensively tested by twenty-three classical benchmark functions and ten CEC2020 test functions and compared with the AOA and other well-known optimization algorithms. The experimental results show that the proposed algorithm is superior to other comparative algorithms on most of the test functions. Furthermore, the test results of two training problems of multi-layer perceptron (MLP) and three classical engineering design problems also indicate that the proposed IAOA is highly effective when dealing with real-world problems.</p> </abstract>

Feature Selection and Knapsack Problem Resolution Based on a Discrete Backtracking Optimization Algorithm

2021 ◽  
Vol 12 (2) ◽  
pp. 1-15
Author(s):  
Khadoudja Ghanem ◽  
Abdesslem Layeb
Keyword(s):  
Feature Selection ◽  
Knapsack Problem ◽  
Optimization Algorithm ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Knapsack Problems ◽  
Support Vector ◽  
Discrete Version ◽  
Search Optimization ◽  
Discrete Algorithms

Backtracking search optimization algorithm is a recent stochastic-based global search algorithm for solving real-valued numerical optimization problems. In this paper, a binary version of backtracking algorithm is proposed to deal with 0-1 optimization problems such as feature selection and knapsack problems. Feature selection is the process of selecting a subset of relevant features for use in model construction. Irrelevant features can negatively impact model performances. On the other hand, knapsack problem is a well-known optimization problem used to assess discrete algorithms. The objective of this research is to evaluate the discrete version of backtracking algorithm on the two mentioned problems and compare obtained results with other binary optimization algorithms using four usual classifiers: logistic regression, decision tree, random forest, and support vector machine. Empirical study on biological microarray data and experiments on 0-1 knapsack problems show the effectiveness of the binary algorithm and its ability to achieve good quality solutions for both problems.

scholarly journals A Novel Parent Centric Crossover with the Log-Logistic Probabilistic Approach Using Multimodal Test Problems for Real-Coded Genetic Algorithms

2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Ehtasham ul Haq ◽  
Ishfaq Ahmad ◽  
Ibrahim M. Almanjahie
Keyword(s):  
Optimization Problems ◽  
Probabilistic Approach ◽  
Population Diversity ◽  
Test Problems ◽  
Crossover Operator ◽  
Local Optima ◽  
Mutation Operators ◽  
Multiple Comparison Test ◽  
Power Mutation ◽  
Real Coded Genetic Algorithms

In this paper, a comprehensive empirical study is conducted to evaluate the performance of a new real-coded crossover operator called Fisk crossover (FX) operator. The basic aim of the proposed study is to preserve population diversity as well as to avoid local optima. In this context, a new crossover operator is designed and developed which is linked with Log-logistic probability distribution. For its global performance, a realistic comparison is made between FX versus double Pareto crossover (DPX), Laplace crossover (LX), and simulated binary crossover (SBX) operators. Moreover, these crossover operators are also used in conjunction with three mutation operators called power mutation (PM), Makinen, Periaux, and Toivanen mutation (MPTM), and nonuniform mutation (NUM) for inclusive evaluation. The performance of probabilistic-based algorithms is tested on a set of twenty-one well-known nonlinear optimization benchmark functions with diverse features. The empirical results show a substantial dominance of FX over other crossover operators with authentication of performance index (PI). Moreover, we also examined the significance of the proposed crossover scheme by administrating ANOVA and Gabriel pairwise multiple comparison test. Finally, the statistically significant results of the proposed crossover scheme have a definite edge over the other schemes, and it is also expected that FX has a great potential to solve complex optimization problems.

An Improved Novel Global Harmony Search Algorithm

2014 ◽  
Vol 644-650 ◽  
pp. 2169-2172
Author(s):  
Zhi Kong ◽  
Guo Dong Zhang ◽  
Li Fu Wang
Keyword(s):  
Convergence Rate ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Harmony Search ◽  
Global Optimum ◽  
Harmony Search Algorithm ◽  
Test Functions ◽  
Benchmark Test ◽  
Novel Method ◽  
Benchmark Test Functions

This paper develops an improved novel global harmony search (INGHS) algorithm for solving optimization problems. INGHS employs a novel method for generating new solution vectors that enhances accuracy and convergence rate of novel global harmony search (NGHS) algorithm. Simulations for five benchmark test functions show that INGHS possesses better ability to find the global optimum than that of harmony search (HS) algorithm. Compared with NGHS and HS, INGHS is better in terms of robustness and efficiency.

Hybrid Harmony Search Algorithm for Global Optimization Problems

2014 ◽  
Vol 1065-1069 ◽  
pp. 3438-3441
Author(s):  
Guo Jun Li
Keyword(s):  
Global Optimization ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Harmony Search ◽  
Population Based ◽  
Harmony Search Algorithm ◽  
Search Method ◽  
Local Optima ◽  
Population Based Algorithm ◽  
Better Than

Harmony search (HS) algorithm is a new population based algorithm, which imitates the phenomenon of musical improvisation process. Its own potential and shortage, one shortage is that it easily trapped into local optima. In this paper, a hybrid harmony search algorithm (HHS) is proposed based on the conception of swarm intelligence. HHS employed a local search method to replace the pitch adjusting operation, and designed an elitist preservation strategy to modify the selection operation. Experiment results demonstrated that the proposed method performs much better than the HS and its improved algorithms (IHS, GHS and NGHS).

Sign in / Sign up

Export Citation Format

Share Document