Pareto Front Identification via Objective Vector Jacobian Matrix Singularity

Author(s):  
Brandon Brown ◽  
Tarunraj Singh ◽  
Rahul Rai

This paper presents a method to identify the exact Pareto front for a multi-objective optimization problem. The developed technique addresses the identification of the Pareto frontier in the cost space and the Pareto set in the design space for both constrained and unconstrained optimization problems. The proposed approach identifies a n – 1 dimensional hypersurface for a multi-objective problem with n cost functions, a subset of which constitute the Pareto front. The n – 1 dimensional hypersurface is identified by enforcing a singularity constraint on the Jacobian of the cost vector with respect to the optimization parameters. Since the boundary is identified in the design space, the relation of design points to the exact Pareto front in the cost space is known. The proposed method is proven effective in the Pareto identification for a set of previously released challenge problems. Six of these examples are included in this paper; 3 unconstrained and 3 constrained.

2017 ◽  
Vol 34 (5) ◽  
pp. 1724-1753 ◽  
Author(s):  
Anand Amrit ◽  
Leifur Leifsson ◽  
Slawomir Koziel

Purpose This paper aims to investigates several design strategies to solve multi-objective aerodynamic optimization problems using high-fidelity simulations. The purpose is to find strategies which reduce the overall optimization time while still maintaining accuracy at the high-fidelity level. Design/methodology/approach Design strategies are proposed that use an algorithmic framework composed of search space reduction, fast surrogate models constructed using a combination of physics-based surrogates and kriging and global refinement of the Pareto front with co-kriging. The strategies either search the full or reduced design space with a low-fidelity model or a physics-based surrogate. Findings Numerical investigations of airfoil shapes in two-dimensional transonic flow are used to characterize and compare the strategies. The results show that searching a reduced design space produces the same Pareto front as when searching the full space. Moreover, as the reduced space is two orders of magnitude smaller (volume-wise), the number of required samples to setup the surrogates can be reduced by an order of magnitude. Consequently, the computational time is reduced from over three days to less than half a day. Originality/value The proposed design strategies are novel and holistic. The strategies render multi-objective design of aerodynamic surfaces using high-fidelity simulation data in moderately sized search spaces computationally tractable.


Author(s):  
Zhenkun Wang ◽  
Qingyan Li ◽  
Qite Yang ◽  
Hisao Ishibuchi

AbstractIt has been acknowledged that dominance-resistant solutions (DRSs) extensively exist in the feasible region of multi-objective optimization problems. Recent studies show that DRSs can cause serious performance degradation of many multi-objective evolutionary algorithms (MOEAs). Thereafter, various strategies (e.g., the $$\epsilon $$ ϵ -dominance and the modified objective calculation) to eliminate DRSs have been proposed. However, these strategies may in turn cause algorithm inefficiency in other aspects. We argue that these coping strategies prevent the algorithm from obtaining some boundary solutions of an extremely convex Pareto front (ECPF). That is, there is a dilemma between eliminating DRSs and preserving boundary solutions of the ECPF. To illustrate such a dilemma, we propose a new multi-objective optimization test problem with the ECPF as well as DRSs. Using this test problem, we investigate the performance of six representative MOEAs in terms of boundary solutions preservation and DRS elimination. The results reveal that it is quite challenging to distinguish between DRSs and boundary solutions of the ECPF.


Author(s):  
Weijun Wang ◽  
Stéphane Caro ◽  
Fouad Bennis ◽  
Oscar Brito Augusto

For Multi-Objective Robust Optimization Problem (MOROP), it is important to obtain design solutions that are both optimal and robust. To find these solutions, usually, the designer need to set a threshold of the variation of Performance Functions (PFs) before optimization, or add the effects of uncertainties on the original PFs to generate a new Pareto robust front. In this paper, we divide a MOROP into two Multi-Objective Optimization Problems (MOOPs). One is the original MOOP, another one is that we take the Robustness Functions (RFs), robust counterparts of the original PFs, as optimization objectives. After solving these two MOOPs separately, two sets of solutions come out, namely the Pareto Performance Solutions (PP) and the Pareto Robustness Solutions (PR). Make a further development on these two sets, we can get two types of solutions, namely the Pareto Robustness Solutions among the Pareto Performance Solutions (PR(PP)), and the Pareto Performance Solutions among the Pareto Robustness Solutions (PP(PR)). Further more, the intersection of PR(PP) and PP(PR) can represent the intersection of PR and PP well. Then the designer can choose good solutions by comparing the results of PR(PP) and PP(PR). Thanks to this method, we can find out the optimal and robust solutions without setting the threshold of the variation of PFs nor losing the initial Pareto front. Finally, an illustrative example highlights the contributions of the paper.


2005 ◽  
Vol 128 (4) ◽  
pp. 874-883 ◽  
Author(s):  
Mian Li ◽  
Shapour Azarm ◽  
Art Boyars

We present a deterministic non-gradient based approach that uses robustness measures in multi-objective optimization problems where uncontrollable parameter variations cause variation in the objective and constraint values. The approach is applicable for cases that have discontinuous objective and constraint functions with respect to uncontrollable parameters, and can be used for objective or feasibility robust optimization, or both together. In our approach, the known parameter tolerance region maps into sensitivity regions in the objective and constraint spaces. The robustness measures are indices calculated, using an optimizer, from the sizes of the acceptable objective and constraint variation regions and from worst-case estimates of the sensitivity regions’ sizes, resulting in an outer-inner structure. Two examples provide comparisons of the new approach with a similar published approach that is applicable only with continuous functions. Both approaches work well with continuous functions. For discontinuous functions the new approach gives solutions near the nominal Pareto front; the earlier approach does not.


Author(s):  
Eliot Rudnick-Cohen

Abstract Multi-objective decision making problems can sometimes involve an infinite number of objectives. In this paper, an approach is presented for solving multi-objective optimization problems containing an infinite number of parameterized objectives, termed “infinite objective optimization”. A formulation is given for infinite objective optimization problems and an approach for checking whether a Pareto frontier is a solution to this formulation is detailed. Using this approach, a new sampling based approach is developed for solving infinite objective optimization problems. The new approach is tested on several different example problems and is shown to be faster and perform better than a brute force approach.


2014 ◽  
Vol 945-949 ◽  
pp. 2241-2247
Author(s):  
De Gao Zhao ◽  
Qiang Li

This paper deals with application of Non-dominated Sorting Genetic Algorithm with elitism (NSGA-II) to solve multi-objective optimization problems of designing a vehicle-borne radar antenna pedestal. Five technical improvements are proposed due to the disadvantages of NSGA-II. They are as follow: (1) presenting a new method to calculate the fitness of individuals in population; (2) renewing the definition of crowding distance; (3) introducing a threshold for choosing elitist; (4) reducing some redundant sorting process; (5) developing a self-adaptive arithmetic cross and mutation probability. The modified algorithm can lead to better population diversity than the original NSGA-II. Simulation results prove rationality and validity of the modified NSGA-II. A uniformly distributed Pareto front can be obtained by using the modified NSGA-II. Finally, a multi-objective problem of designing a vehicle-borne radar antenna pedestal is settled with the modified algorithm.


Author(s):  
Alexandre Medi ◽  
◽  
Tenda Okimoto ◽  
Katsumi Inoue ◽  
◽  
...  

A Distributed Constraint Optimization Problem (DCOP) is a fundamental problem that can formalize various applications related to multi-agent cooperation. Many application problems in multi-agent systems can be formalized as DCOPs. However, many real world optimization problems involve multiple criteria that should be considered separately and optimized simultaneously. A Multi-Objective Distributed Constraint Optimization Problem (MO-DCOP) is an extension of a mono-objective DCOP. Compared to DCOPs, there exists few works on MO-DCOPs. In this paper, we develop a novel complete algorithm for solving an MO-DCOP. This algorithm utilizes a widely used method called Pareto Local Search (PLS) to generate an approximation of the Pareto front. Then, the obtained information is used to guide the search thresholds in a Branch and Bound algorithm. In the evaluations, we evaluate the runtime of our algorithm and show empirically that using a Pareto front approximation obtained by a PLS algorithm allows to significantly speed-up the search in a Branch and Bound algorithm.


Author(s):  
Jesper Kristensen ◽  
You Ling ◽  
Isaac Asher ◽  
Liping Wang

Adaptive sampling methods have been used to build accurate meta-models across large design spaces from which engineers can explore data trends, investigate optimal designs, study the sensitivity of objectives on the modeling design features, etc. For global design optimization applications, adaptive sampling methods need to be extended to sample more efficiently near the optimal domains of the design space (i.e., the Pareto front/frontier in multi-objective optimization). Expected Improvement (EI) methods have been shown to be efficient to solve design optimization problems using meta-models by incorporating prediction uncertainty. In this paper, a set of state-of-the-art methods (hypervolume EI method and centroid EI method) are presented and implemented for selecting sampling points for multi-objective optimizations. The classical hypervolume EI method uses hyperrectangles to represent the Pareto front, which shows undesirable behavior at the tails of the Pareto front. This issue is addressed utilizing the concepts from physical programming to shape the Pareto front. The modified hypervolume EI method can be extended to increase local Pareto front accuracy in any area identified by an engineer, and this method can be applied to Pareto frontiers of any shape. A novel hypervolume EI method is also developed that does not rely on the assumption of hyperrectangles, but instead assumes the Pareto frontier can be represented by a convex hull. The method exploits fast methods for convex hull construction and numerical integration, and results in a Pareto front shape that is desired in many practical applications. Various performance metrics are defined in order to quantitatively compare and discuss all methods applied to a particular 2D optimization problem from the literature. The modified hypervolume EI methods lead to dramatic resource savings while improving the predictive capabilities near the optimal objective values.


2011 ◽  
Vol 467-469 ◽  
pp. 2129-2136
Author(s):  
Tung Kuan Liu ◽  
Hsin Yuan Chang ◽  
Wen Ping Wu ◽  
Chiu Hung Chen ◽  
Min Rong Ho

This paper proposes a novel multiobjective genetic algorithm (MOGA), Evaluated Preference Genetic Algorithm (EPGA), for efficiently solving engineering multiobjective optimization problems. EPGA utilizes a preferred objective vector to perform a fast multiobjective ranking schema within a low computation complexity O(MNlogN) where N is the size of genetic population and M is the number of objectives. For verifying the proposed algorithms, this paper studies two engineering problems in which multiple mutual-conflicted objectives should be considered. According to the experimental results, the proposed EPGA can efficiently explore the Pareto front and provide very good solution capabilities for the engineering optimization problems.


Author(s):  
Samira El Moumen ◽  
Siham Ouhimmou

Various engineering design problems are formulated as constrained multi-objective optimization problems. One of the relevant and popular methods that deals with these problems is the weighted method. However, the major inconvenience with its application is that it does not yield a well distributed set. In this study, the use of the Normal Boundary Intersection approach (NBI) is proposed, which is effective in obtaining an evenly distributed set of points in the Pareto set. Given an evenly distributed set of weights, it can be strictly shown that this approach is absolutely independent of the relative scales of the functions. Moreover, in order to ensure the convergence to the Global Pareto frontier, NBI approach has to be aligned with a global optimization method. Thus, the following paper suggests NBI-Simulated Annealing Simultaneous Perturbation method (NBI-SASP) as a new method for multiobjective optimization problems. The study shall test also the applicability of the NBI-SASP approach using different engineering multi-objective optimization problems and the findings shall be compared to a method of reference (NSGA). Results clearly demonstrate that the suggested method is more efficient when it comes to search ability and it provides a well distributed global Pareto Front.


Sign in / Sign up

Export Citation Format

Share Document