scholarly journals Research and Study of the Hybrid Algorithms Based on the Collective Behavior of Fish Schools and Classical Optimization Methods

Algorithms ◽  
2020 ◽  
Vol 13 (4) ◽  
pp. 85 ◽  
Author(s):  
Liliya A. Demidova ◽  
Artyom V. Gorchakov
Keyword(s):  
Collective Behavior ◽  
Hybrid Algorithm ◽  
Gradient Descent ◽  
Optimization Problems ◽  
Computation Time ◽  
Optimization Methods ◽  
Hybrid Algorithms ◽  
Fish Schools ◽  
Fish School ◽  
Classical Optimization

Inspired by biological systems, swarm intelligence algorithms are widely used to solve multimodal optimization problems. In this study, we consider the hybridization problem of an algorithm based on the collective behavior of fish schools. The algorithm is computationally inexpensive compared to other population-based algorithms. Accuracy of fish school search increases with the increase of predefined iteration count, but this also affects computation time required to find a suboptimal solution. We propose two hybrid approaches, intending to improve the evolutionary-inspired algorithm accuracy by using classical optimization methods, such as gradient descent and Newton’s optimization method. The study shows the effectiveness of the proposed hybrid algorithms, and the strong advantage of the hybrid algorithm based on fish school search and gradient descent. We provide a solution for the linearly inseparable exclusive disjunction problem using the developed algorithm and a perceptron with one hidden layer. To demonstrate the effectiveness of the algorithms, we visualize high dimensional loss surfaces near global extreme points. In addition, we apply the distributed version of the most effective hybrid algorithm to the hyperparameter optimization problem of a neural network.

Afterword

2010 ◽  
pp. 269-272
Author(s):  
E. Parsopoulos Konstantinos ◽  
N. Vrahatis Michael
Keyword(s):  
Optimization Problems ◽  
Optimization Methods ◽  
Special Structure ◽  
Integer Optimization ◽  
Hybrid Schemes ◽  
Research Results ◽  
Global Minimizers ◽  
Classical Optimization

In the previous chapters, we presented the fundamental concepts and variants of PSO, as along with a multitude of recent research results. The reported results suggest that PSO can be a very useful tool for solving optimization problems from different scientific and technological fields, especially in cases where classical optimization methods perform poorly or their application involves formidable technical difficulties due to the problem’s special structure or nature. PSO was capable of addressing continuous and integer optimization problems, handling noisy and multiobjective cases, and producing efficient hybrid schemes in combination with specialized techniques or other algorithms in order to detect multiple (local or global) minimizers or control its own parameters.

Development of a Common Platform for Testing Metamodel Based Design Optimization Methods

2013 ◽  
Author(s):  
Adel A. Younis ◽  
George H. Cheng ◽  
G. Gary Wang ◽  
Zuomin Dong
Keyword(s):  
Design Optimization ◽  
Optimization Problems ◽  
Optimization Algorithms ◽  
Computation Time ◽  
Optimization Methods ◽  
Global Optimum ◽  
Test Problems ◽  
Test Bed ◽  
Test Procedures ◽  
Local Optima

Metamodel based design optimization (MBDO) algorithms have attracted considerable interests in recent years due to their special capability in dealing with complex optimization problems with computationally expensive objective and constraint functions and local optima. Conventional unimodal-based optimization algorithms and stochastic global optimization algorithms either miss the global optimum frequently or require unacceptable computation time. In this work, a generic testbed/platform for evaluating various MBDO algorithms has been introduced. The purpose of the platform is to facilitate quantitative comparison of different MBDO algorithms using standard test problems, test procedures, and test outputs, as well as to improve the efficiency of new algorithm testing and improvement. The platform consists of a comprehensive test function database that contains about 100 benchmark functions and engineering problems. The testbed accepts any optimization algorithm to be tested, and only requires minor modifications to meet the test-bed requirements. The testbed is useful in comparing the performance of competing algorithms through execution of same problems. It allows researchers and practitioners to test and choose the most suitable optimization tool for their specific needs. It also helps to increase confidence and reliability of the newly developed MBDO tools. Many new MBDO algorithms, including Mode Pursuing Sampling (MPS), Pareto Set Pursuing (PSP), and Space Exploration and Unimodal Region Elimination (SEUMRE), were tested in this work to demonstrate its functionality and benefits.

scholarly journals Grand Tour Algorithm: Novel Swarm-Based Optimization for High-Dimensional Problems

Processes ◽  
2020 ◽  
Vol 8 (8) ◽  
pp. 980
Author(s):  
Gustavo Meirelles ◽  
Bruno Brentan ◽  
Joaquín Izquierdo ◽  
Edevar Luvizotto
Keyword(s):  
Systems Engineering ◽  
Collective Behavior ◽  
Optimization Problems ◽  
Optimization Technique ◽  
Optimal Solution ◽  
Sensitivity Analyses ◽  
Grand Tour ◽  
Agent Based ◽  
Local Optimal Solution ◽  
Classical Optimization

Agent-based algorithms, based on the collective behavior of natural social groups, exploit innate swarm intelligence to produce metaheuristic methodologies to explore optimal solutions for diverse processes in systems engineering and other sciences. Especially for complex problems, the processing time, and the chance to achieve a local optimal solution, are drawbacks of these algorithms, and to date, none has proved its superiority. In this paper, an improved swarm optimization technique, named Grand Tour Algorithm (GTA), based on the behavior of a peloton of cyclists, which embodies relevant physical concepts, is introduced and applied to fourteen benchmarking optimization problems to evaluate its performance in comparison to four other popular classical optimization metaheuristic algorithms. These problems are tackled initially, for comparison purposes, with 1000 variables. Then, they are confronted with up to 20,000 variables, a really large number, inspired in the human genome. The obtained results show that GTA clearly outperforms the other algorithms. To strengthen GTA’s value, various sensitivity analyses are performed to verify the minimal influence of the initial parameters on efficiency. It is demonstrated that the GTA fulfils the fundamental requirements of an optimization algorithm such as ease of implementation, speed of convergence, and reliability. Since optimization permeates modeling and simulation, we finally propose that GTA will be appealing for the agent-based community, and of great help for a wide variety of agent-based applications.

scholarly journals THE EFFICIENCY ANALYSIS OF MULTI-AGENT OPTIMIZATION METHODS OF AIRCRAFT DESIGNS ELEMENTS

2019 ◽  
Vol 22 (2) ◽  
pp. 96-108
Author(s):  
A. V. Panteleev ◽  
M.M. S. Karane
Keyword(s):  
Optimization Problems ◽  
Optimization Methods ◽  
Metaheuristic Algorithms ◽  
Great Success ◽  
Structural Elements ◽  
Development Environment ◽  
Fish School ◽  
Krill Herd ◽  
Multi Agent ◽  
The Given

The article considers the use of three multi-agent methods for optimizing structural elements of aircraft. The research describes strategies for finding solutions to multi-agent metaheuristic algorithms, such as: fish school search, krill herd, and imperialist competition algorithm. The work of these methods is based on the processes occurring in an environment that features many agents. Agents have the opportunity to exchange information in order to find a solution to the problem. These methods allow you to find an approximate solution, but, nevertheless, with great success are used in practice. In this regard, the described metaheuristic algorithms were applied to the optimization problems of structural elements of aircraft such as: welded beam, high pressure vessel, gearbox and tension spring. The article adduces the formulation of these problems: the objective function, a set of constraints and a set of admissible solutions are indicated, recommendations on the choice of parameters of the methods used are given. To solve the problems of optimizing the elements of aircraft construction, a set of software elements was formed in the development environment of Microsoft Visual Studio in C #. This complex of programs allows you to solve the given problems by each of the described multi-agent methods. The software allows you to select a method, a task and select the method parameters and the penalty function coefficients in the best possible way. The results of the solution were compared with each other and with the well- known solution. According to the numerical results of solving these tasks, we can conclude that the algorithmic and software created allow us to find a solution close to the exact one in a reasonable time.

scholarly journals Settings-Free Hybrid Metaheuristic General Optimization Methods

Mathematics ◽  
2020 ◽  
Vol 8 (7) ◽  
pp. 1092
Author(s):  
Héctor Migallón ◽  
Akram Belazi ◽  
José-Luis Sánchez-Romero ◽  
Héctor Rico ◽  
Antonio Jimeno-Morenilla
Keyword(s):  
Control Parameter ◽  
Optimization Problems ◽  
Optimization Algorithms ◽  
Parameter Tuning ◽  
Optimization Methods ◽  
Population Based ◽  
Hybrid Algorithms ◽  
Hybridization Technique ◽  
Control Parameters ◽  
Teaching Learning

Several population-based metaheuristic optimization algorithms have been proposed in the last decades, none of which are able either to outperform all existing algorithms or to solve all optimization problems according to the No Free Lunch (NFL) theorem. Many of these algorithms behave effectively, under a correct setting of the control parameter(s), when solving different engineering problems. The optimization behavior of these algorithms is boosted by applying various strategies, which include the hybridization technique and the use of chaotic maps instead of the pseudo-random number generators (PRNGs). The hybrid algorithms are suitable for a large number of engineering applications in which they behave more effectively than the thoroughbred optimization algorithms. However, they increase the difficulty of correctly setting control parameters, and sometimes they are designed to solve particular problems. This paper presents three hybridizations dubbed HYBPOP, HYBSUBPOP, and HYBIND of up to seven algorithms free of control parameters. Each hybrid proposal uses a different strategy to switch the algorithm charged with generating each new individual. These algorithms are Jaya, sine cosine algorithm (SCA), Rao’s algorithms, teaching-learning-based optimization (TLBO), and chaotic Jaya. The experimental results show that the proposed algorithms perform better than the original algorithms, which implies the optimal use of these algorithms according to the problem to be solved. One more advantage of the hybrid algorithms is that no prior process of control parameter tuning is needed.

On the Analysis of HPSO Improvement by Use of the Volitive Operator of Fish School Search

2013 ◽  
Vol 4 (1) ◽  
pp. 62-77
Author(s):  
George M. Cavalcanti-Júnior ◽  
Fernando B. Lima-Neto ◽  
Carmelo J. A. Bastos-Filho
Keyword(s):  
Hybrid Algorithm ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Dynamic Environments ◽  
Dynamic Problems ◽  
Major Difficulty ◽  
Swarm Optimization ◽  
Fish School ◽  
Hybrid Approaches ◽  
Novel Approach

Swarm Intelligence algorithms have been extensively applied to solve optimization problems. However, in some domains even well-established techniques such as Particle Swarm Optimization (PSO) may not present the necessary ability to generate diversity during the process of the swarm convergence. Indeed, this is the major difficulty to use PSO to tackle dynamic problems. Many efforts to overcome this weakness have been made. One of them is through the hybridization of the PSO with other algorithms. For example, the Volitive PSO is a hybrid algorithm that presents as good performance on dynamic problems by applying a very interesting feature, the collective volitive operator, which was extracted from the Fish School Search algorithm and embedded into PSO. In this paper, the authors investigated further hybridizations in line with the Volitive PSO approach. This time they used the Heterogeneous PSO instead of the PSO, and named this novel approach Volitive HPSO. In the paper, the authors investigate the influence of the collective volitive operator (of FSS) in the HPSO. The results show that this operator significantly improves HPSO performance when compared to the non-hybrid approaches of PSO and its variations in dynamic environments.

scholarly journals Comparative assessment of smooth and non-smooth optimization solvers in HANSO software

2021 ◽  
Vol 12 (1) ◽  
pp. 39-46
Author(s):  
Ali Hakan Tor
Keyword(s):  
Nonsmooth Optimization ◽  
Hybrid Algorithm ◽  
Optimization Problems ◽  
Optimization Methods ◽  
Comparative Assessment ◽  
Test Problems ◽  
Bfgs Method ◽  
Smooth Optimization ◽  
Optimization Solvers ◽  
Academic Test

The aim of this study is to compare the performance of smooth and nonsmooth optimization solvers from HANSO (Hybrid Algorithm for Nonsmooth Optimization) software. The smooth optimization solver is the implementation of the Broyden-Fletcher-Goldfarb-Shanno (BFGS) method and the nonsmooth optimization solver is the Hybrid Algorithm for Nonsmooth Optimization. More precisely, the nonsmooth optimization algorithm is the combination of the BFGS and the Gradient Sampling Algorithm (GSA). We use well-known collection of academic test problems for nonsmooth optimization containing both convex and nonconvex problems. The motivation for this research is the importance of the comparative assessment of smooth optimization methods for solving nonsmooth optimization problems. This assessment will demonstrate how successful is the BFGS method for solving nonsmooth optimization problems in comparison with the nonsmooth optimization solver from HANSO. Performance profiles using the number iterations, the number of function evaluations and the number of subgradient evaluations are used to compare solvers.

Software suite for determining the tilts of tower-type structures according to terrestrial laser scanning

2020 ◽  
Vol 961 (7) ◽  
pp. 2-7
Author(s):  
A.V. Zubov ◽  
N.N. Eliseeva
Keyword(s):  
Laser Scanning ◽  
Optimization Problems ◽  
Optimization Methods ◽  
User Participation ◽  
Software Suite ◽  
Current State ◽  
Visual Basic For Applications ◽  
Operational Data ◽  
Theoretical Developments

The authors describe a software suite for determining tilt degrees of tower-type structures according to ground laser scanning indication. Defining the tilt of the pipe is carried out with a set of measured data through approximating the sections by circumferences. They are constructed using one of the simplest search engine optimization methods (evolutionary algorithm). Automatic filtering the scan of the current section from distorting data is performed by the method of assessing the quality of models constructed with that of least squares. The software was designed using Visual Basic for Applications. It contains several blocks (subprograms), with each of them performing a specific task. The developed complex enables obtaining operational data on the current state of the object with minimal user participation in the calculation process. The software suite is the result of practical implementing theoretical developments on the possibilities of using search methods at solving optimization problems in geodetic practice.

Sign in / Sign up

Export Citation Format

Share Document