scholarly journals A GPU-Enabled Compact Genetic Algorithm for Very Large-Scale Optimization Problems

Mathematics ◽  
2020 ◽  
Vol 8 (5) ◽  
pp. 758
Author(s):  
Andrea Ferigo ◽  
Giovanni Iacca
Keyword(s):  
Genetic Algorithm ◽  
Large Scale ◽  
Optimization Problems ◽  
Search Space ◽  
Large Scale Problems ◽  
Processing Power ◽  
Compact Genetic Algorithm ◽  
Estimation Of Distribution ◽  
Feasible Solutions ◽  
Compact Optimization

The ever-increasing complexity of industrial and engineering problems poses nowadays a number of optimization problems characterized by thousands, if not millions, of variables. For instance, very large-scale problems can be found in chemical and material engineering, networked systems, logistics and scheduling. Recently, Deb and Myburgh proposed an evolutionary algorithm capable of handling a scheduling optimization problem with a staggering number of variables: one billion. However, one important limitation of this algorithm is its memory consumption, which is in the order of 120 GB. Here, we follow up on this research by applying to the same problem a GPU-enabled “compact” Genetic Algorithm, i.e., an Estimation of Distribution Algorithm that instead of using an actual population of candidate solutions only requires and adapts a probabilistic model of their distribution in the search space. We also introduce a smart initialization technique and custom operators to guide the search towards feasible solutions. Leveraging the compact optimization concept, we show how such an algorithm can optimize efficiently very large-scale problems with millions of variables, with limited memory and processing power. To complete our analysis, we report the results of the algorithm on very large-scale instances of the OneMax problem.

scholarly journals Fertilization optimization algorithm on CEC2015 and large scale problems

2021 ◽  
Author(s):  
Hazim Nasir Ghafil ◽  
Shaymaa Alsamia ◽  
Károly Jármai
Keyword(s):  
Optimization Algorithm ◽  
Large Scale ◽  
Optimization Problems ◽  
Random Search ◽  
Search Space ◽  
Large Scale Optimization ◽  
Biologically Inspired ◽  
Large Scale Problems ◽  
Comparison Results ◽  
Scale Optimization

Abstract This work, presents a novel optimizer called fertilization optimization algorithm, which is based on levy flight and random search within a search space. It is a biologically inspired algorithm by the fertilization of the egg in reproduction of mammals. The performance of the algorithm was compared with other optimization algorithms on CEC2015 time expensive benchmarks and large scale optimization problems. Remarkably, the fertilization optimization algorithm has overcome other optimizers in many cases and the examination and comparison results are encouraging to use the fertilization optimization algorithm in other possible applications.

scholarly journals Genetic Algorithm – A Sensible Evolutionary Optimization Technique

2019 ◽  
Vol 8 (9) ◽  
pp. 2805-2809
Keyword(s):  
Genetic Algorithm ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Random Search ◽  
Optimization Technique ◽  
Search Space ◽  
Effective Population ◽  
Natural Systems ◽  
Heuristic Search Algorithm ◽  
Feasible Solutions

The study presents a pragmatic outlook of genetic algorithm. Many biological algorithms are inspired for their ability to evolve towards best solutions and of all; genetic algorithm is widely accepted as they well suit evolutionary computing models. Genetic algorithm could generate optimal solutions on random as well as deterministic problems. Genetic algorithm is a mathematical approach to imitate the processes studied in natural evolution. The methodology of genetic algorithm is intensively experimented in order to use the power of evolution to solve optimization problems. Genetic algorithm is an adaptive heuristic search algorithm based on the evolutionary ideas of genetics and natural selection. Genetic algorithm exploits random search approach to solve optimization problems. Genetic algorithm takes benefits of historical information to direct the search into the convergence of better performance within the search space. The basic techniques of evolutionary algorithms are observed to be simulating the processes in natural systems. These techniques are aimed to carry effective population to the next generation and ensure the survival of the fittest. Nature supports the domination of stronger over the weaker ones in any kind. In this study, we proposed the arithmetic views of the behavior and operators of genetic algorithm that support the evolution of feasible solutions to optimized solutions.

scholarly journals On the Use of Compact Approaches in Evolution Strategies

2014 ◽  
Vol 3 (4) ◽  
pp. 13-23
Author(s):  
Anderson Sergio ◽  
Sidartha Carvalho ◽  
Marco Rego
Keyword(s):  
Genetic Algorithm ◽  
Probability Distribution ◽  
Evolutionary Algorithms ◽  
Differential Evolution ◽  
Optimization Problems ◽  
Evolution Strategies ◽  
Processing Power ◽  
Compact Genetic Algorithm ◽  
Efficient Alternative ◽  
Computing Environments

Compact evolutionary algorithms have proven to be an efficient alternative for solving optimization problems in computing environments with low processing power. In this kind of solution, a probability distribution simulates the behavior of a population, thus looking for memory savings. Several compact algorithms have been proposed, including the compact genetic algorithm and compact differential evolution. This work aims to investigate the use of compact approaches in other important evolutionary algorithms: evolution strategies. This paper proposes two different approaches for compact versions of evolution strategies. Experiments were performed and the results analyzed. The results showed that, depending on the nature of problem, the use of the compact version of Evolution Strategies can be rewarding.

scholarly journals Investigation of Improved Cooperative Coevolution for Large-Scale Global Optimization Problems

Algorithms ◽  
2021 ◽  
Vol 14 (5) ◽  
pp. 146
Author(s):  
Aleksei Vakhnin ◽  
Evgenii Sopov
Keyword(s):  
Global Optimization ◽  
Evolutionary Algorithms ◽  
Numerical Experiments ◽  
Large Scale ◽  
Optimization Problems ◽  
State Of The Art ◽  
Fixed Number ◽  
High Dimensional ◽  
Cooperative Coevolution ◽  
Large Scale Problems

Modern real-valued optimization problems are complex and high-dimensional, and they are known as “large-scale global optimization (LSGO)” problems. Classic evolutionary algorithms (EAs) perform poorly on this class of problems because of the curse of dimensionality. Cooperative Coevolution (CC) is a high-performed framework for performing the decomposition of large-scale problems into smaller and easier subproblems by grouping objective variables. The efficiency of CC strongly depends on the size of groups and the grouping approach. In this study, an improved CC (iCC) approach for solving LSGO problems has been proposed and investigated. iCC changes the number of variables in subcomponents dynamically during the optimization process. The SHADE algorithm is used as a subcomponent optimizer. We have investigated the performance of iCC-SHADE and CC-SHADE on fifteen problems from the LSGO CEC’13 benchmark set provided by the IEEE Congress of Evolutionary Computation. The results of numerical experiments have shown that iCC-SHADE outperforms, on average, CC-SHADE with a fixed number of subcomponents. Also, we have compared iCC-SHADE with some state-of-the-art LSGO metaheuristics. The experimental results have shown that the proposed algorithm is competitive with other efficient metaheuristics.

Genetic Algorithm and Other Meta-Heuristics

2005 ◽  
pp. 144-173 ◽  
Author(s):  
Bernard K.S. Cheung
Keyword(s):  
Genetic Algorithm ◽  
Large Scale ◽  
Optimization Problems ◽  
Optimal Solution ◽  
Schema Theory ◽  
Heuristic Methods ◽  
Optimal Solutions ◽  
Corporate Globalization ◽  
Global Optimal ◽  
Mutation And Selection

Genetic algorithms have been applied in solving various types of large-scale, NP-hard optimization problems. Many researchers have been investigating its global convergence properties using Schema Theory, Markov Chain, etc. A more realistic approach, however, is to estimate the probability of success in finding the global optimal solution within a prescribed number of generations under some function landscapes. Further investigation reveals that its inherent weaknesses that affect its performance can be remedied, while its efficiency can be significantly enhanced through the design of an adaptive scheme that integrates the crossover, mutation and selection operations. The advance of Information Technology and the extensive corporate globalization create great challenges for the solution of modern supply chain models that become more and more complex and size formidable. Meta-heuristic methods have to be employed to obtain near optimal solutions. Recently, a genetic algorithm has been reported to solve these problems satisfactorily and there are reasons for this.

scholarly journals Asynchronous Delay-Aware Accelerated Proximal Coordinate Descent for Nonconvex Nonsmooth Problems

2019 ◽  
Vol 33 ◽  
pp. 1528-1535
Author(s):  
Ehsan Kazemi ◽  
Liqiang Wang
Keyword(s):  
Large Scale ◽  
Convergence Rates ◽  
Optimization Problems ◽  
Coordinate Descent ◽  
Performance Guarantee ◽  
Nonsmooth Problems ◽  
Descent Property ◽  
Large Scale Problems ◽  
Nonconvex And Nonsmooth Optimization ◽  
Sufficient Descent

Nonconvex and nonsmooth problems have recently attracted considerable attention in machine learning. However, developing efficient methods for the nonconvex and nonsmooth optimization problems with certain performance guarantee remains a challenge. Proximal coordinate descent (PCD) has been widely used for solving optimization problems, but the knowledge of PCD methods in the nonconvex setting is very limited. On the other hand, the asynchronous proximal coordinate descent (APCD) recently have received much attention in order to solve large-scale problems. However, the accelerated variants of APCD algorithms are rarely studied. In this paper, we extend APCD method to the accelerated algorithm (AAPCD) for nonsmooth and nonconvex problems that satisfies the sufficient descent property, by comparing between the function values at proximal update and a linear extrapolated point using a delay-aware momentum value. To the best of our knowledge, we are the first to provide stochastic and deterministic accelerated extension of APCD algorithms for general nonconvex and nonsmooth problems ensuring that for both bounded delays and unbounded delays every limit point is a critical point. By leveraging Kurdyka-Łojasiewicz property, we will show linear and sublinear convergence rates for the deterministic AAPCD with bounded delays. Numerical results demonstrate the practical efficiency of our algorithm in speed.

scholarly journals Genetic Algorithm-Based Variable Value Control Method for Solving the Ground Target Attacking Weapon-Target Allocation Problem

2019 ◽  
Vol 2019 ◽  
pp. 1-9 ◽  
Author(s):  
Chao Wang ◽  
Guangyuan Fu ◽  
Daqiao Zhang ◽  
Hongqiao Wang ◽  
Jiufen Zhao
Keyword(s):  
Genetic Algorithm ◽  
Large Scale ◽  
Control Method ◽  
Search Space ◽  
Initial Population ◽  
Improved Genetic Algorithm ◽  
Mutation Strategy ◽  
Ground Target ◽  
Value Range ◽  
Target Allocation

Key ground targets and ground target attacking weapon types are complex and diverse; thus, the weapon-target allocation (WTA) problem has long been a great challenge but has not yet been adequately addressed. A timely and reasonable WTA scheme not only helps to seize a fleeting combat opportunity but also optimizes the use of weaponry resources to achieve maximum battlefield benefits at the lowest cost. In this study, we constructed a ground target attacking WTA (GTA-WTA) model and designed a genetic algorithm-based variable value control method to address the issue that some intelligent algorithms are too slow in resolving the problem of GTA-WTA due to the large scale of the problem or are unable to obtain a feasible solution. The proposed method narrows the search space and improves the search efficiency by constraining and controlling the variable value range of the individuals in the initial population and ensures the quality of the solution by improving the mutation strategy to expand the range of variables. The simulation results show that the improved genetic algorithm (GA) can effectively solve the large-scale GTA-WTA problem with good performance.

scholarly journals AN IMPROVED ADAPTIVE TRUST-REGION METHOD FOR UNCONSTRAINED OPTIMIZATION

2014 ◽  
Vol 19 (4) ◽  
pp. 469-490 ◽  
Author(s):  
Hamid Esmaeili ◽  
Morteza Kimiaei
Keyword(s):  
Unconstrained Optimization ◽  
Large Scale ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Standard Test ◽  
Test Problems ◽  
Unconstrained Optimization Problems ◽  
Large Scale Problems ◽  
Adaptive Radius

In this study, we propose a trust-region-based procedure to solve unconstrained optimization problems that take advantage of the nonmonotone technique to introduce an efficient adaptive radius strategy. In our approach, the adaptive technique leads to decreasing the total number of iterations, while utilizing the structure of nonmonotone formula helps us to handle large-scale problems. The new algorithm preserves the global convergence and has quadratic convergence under suitable conditions. Preliminary numerical experiments on standard test problems indicate the efficiency and robustness of the proposed approach for solving unconstrained optimization problems.

scholarly journals Improving Genetic Algorithm with Fine-Tuned Crossover and Scaled Architecture

2016 ◽  
Vol 2016 ◽  
pp. 1-10 ◽  
Author(s):  
Ajay Shrestha ◽  
Ausif Mahmood
Keyword(s):  
Genetic Algorithm ◽  
Evolutionary Biology ◽  
Optimization Problems ◽  
Search Space ◽  
Island Model ◽  
Fine Tuning ◽  
Small Subset ◽  
Combinatorial Optimization Problems ◽  
Mutation Operators ◽  
New Concepts

Genetic Algorithm (GA) is a metaheuristic used in solving combinatorial optimization problems. Inspired by evolutionary biology, GA uses selection, crossover, and mutation operators to efficiently traverse the solution search space. This paper proposes nature inspired fine-tuning to the crossover operator using the untapped idea of Mitochondrial DNA (mtDNA). mtDNA is a small subset of the overall DNA. It differentiates itself by inheriting entirely from the female, while the rest of the DNA is inherited equally from both parents. This unique characteristic of mtDNA can be an effective mechanism to identify members with similar genes and restrict crossover between them. It can reduce the rate of dilution of diversity and result in delayed convergence. In addition, we scale the well-known Island Model, where instances of GA are run independently and population members exchanged periodically, to a Continental Model. In this model, multiple web services are executed with each web service running an island model. We applied the concept of mtDNA in solving Traveling Salesman Problem and to train Neural Network for function approximation. Our implementation tests show that leveraging these new concepts of mtDNA and Continental Model results in relative improvement of the optimization quality of GA.

Evolving Particle Swarm Optimization Implemented by a Genetic Algorithm

2008 ◽  
Vol 12 (3) ◽  
pp. 284-289 ◽  
Author(s):  
Jenn-Long Liu ◽  
Keyword(s):  
Genetic Algorithm ◽  
Particle Swarm Optimization ◽  
Social Learning ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Search Space ◽  
Design Parameters ◽  
Search Process ◽  
Swarm Optimization ◽  
Learning Rates

Particle swarm optimization (PSO) is a promising evolutionary approach related to a particle moves over the search space with velocity, which is adjusted according to the flying experiences of the particle and its neighbors, and flies towards the better and better search area over the course of search process. Although the PSO is effective in solving the global optimization problems, there are some crucial user-input parameters, such as cognitive and social learning rates, affect the performance of algorithm since the search process of a PSO algorithm is nonlinear and complex. Consequently, a PSO with well-selected parameter settings may result in good performance. This work develops an evolving PSO based on the Clerc’s PSO to evaluate the fitness of objective function and a genetic algorithm (GA) to evolve the optimal design parameters to provide the usage of PSO. The crucial design parameters studied herein include the cognitive and social learning rates as well as constriction factor for the Clerc’s PSO. Several benchmarking cases are experimented to generalize a set of optimal parameters via the evolving PSO. Furthermore, the better parameters are applied to the engineering optimization of a pressure vessel design.

Sign in / Sign up

Export Citation Format

Share Document