A MO-BAYESIAN OPTIMIZATION APPROACH USING THE WEIGHTED TCHEBYCHEFF METHOD

2021 ◽  
pp. 1-30
Author(s):  
Arpan Biswas ◽  
Claudio Fuentes ◽  
Christopher Hoyle

Abstract Bayesian optimization (BO) is a low-cost global optimization tool for expensive black-box objective functions, where we learn from prior evaluated designs, update a posterior surrogate Gaussian process model, and select new designs for future evaluation using an acquisition function. This research focuses upon developing a BO model with multiple black-box objective functions. In the standard Multi-Objective optimization (MOO) problem, the weighted Tchebycheff method is efficiently used to find both convex and non-convex Pareto frontiers. This approach requires knowledge of utopia values before we start optimization. However, in the BO framework, since the functions are expensive to evaluate, it is very expensive to obtain the utopia values as a prior knowledge. Therefore, in this paper, we develop a MO-BO framework where we calibrate with multiple linear regression (MLR) models to estimate the utopia value for each objective as a function of design input variables; the models are updated iteratively with sampled training data from the proposed multi-objective BO. This iteratively estimated mean utopia values is used to formulate the weighted Tchebycheff multi-objective acquisition function. The proposed approach is implemented in optimizing thin tube geometries under constant loading of temperature and pressure, with minimizing the risk of creep-fatigue failure and design cost, along with risk-based and manufacturing constraints. Finally, the model accuracy with frequentist, Bayesian and without MLR-based calibration are compared to true Pareto solutions.

Author(s):  
Arpan Biswas ◽  
Claudio Fuentes ◽  
Christopher Hoyle

Abstract Bayesian optimization (BO) is a low-cost global optimization tool for expensive black-box objective functions, where we learn from prior evaluated designs, update a posterior surrogate Gaussian process model, and select new designs for future evaluation using an acquisition function. This research focuses upon developing a BO model with multiple black-box objective functions. In the standard multi-objective optimization problem, the weighted Tchebycheff method is efficiently used to find both convex and non-convex Pareto frontier. This approach requires knowledge of utopia values before we start optimization. However, in the BO framework, since the functions are expensive to evaluate, it is very expensive to obtain the utopia values as a priori knowledge. Therefore, in this paper, we develop a Multi-Objective Bayesian Optimization (MO-BO) framework where we calibrate with Multiple Linear Regression (MLR) models to estimate the utopia value for each objective as a function of design input variables; the models are updated iteratively with sampled training data from the proposed multi-objective BO. The iteratively estimated mean utopia values are used to formulate the weighted Tchebycheff multi-objective acquisition function. The proposed approach is implemented in optimizing a thin tube design under constant loading of temperature and pressure, with multiple objectives such as minimizing the risk of creep-fatigue failure and design cost along with risk-based and manufacturing constraints. Finally, the model accuracy with and without MLR-based calibration is compared to the true Pareto solutions. The results show potential broader impacts, future research directions for further improving the proposed MO-BO model, and potential extensions to the application of large-scale design problems.


2017 ◽  
Author(s):  
Guillaume Pirot ◽  
Tipaluck Krityakierne ◽  
David Ginsbourger ◽  
Philippe Renard

Abstract. A Bayesian optimization approach to localize a contaminant source is proposed. The localization problem is illustrated with two 2D synthetic cases which display sharp transmissivity contrasts and specific connectivity patterns. These cases generate highly non-linear objective functions that present multiple local minima. A derivative-free global optimization algorithm relying on a Gaussian Process model and on the Expected Improvement criterion is used to efficiently localize the minimum of the objective function which identifies the contaminant source. In addition, the generated objective functions are made available as a benchmark to further allow the comparison of optimization algorithms on functions characterized by multiple minima and inspired by concrete field applications.


Author(s):  
Mariana Gomes da Motta Macedo ◽  
Carmelo J. A. Bastos-Filho ◽  
Susana M. Vieira ◽  
João M. C. Sousa

Fish school search (FSS) algorithm has inspired several adaptations for multi-objective problems or binary optimization. However, there is no particular proposition to solve both problems simultaneously. The proposed multi-objective approach binary fish school search (MOBFSS) aims to solve optimization problems with two or three conflicting objective functions with binary decision input variables. MOBFSS is based on the dominance concept used in the multi-objective fish school search (MOFSS) and the threshold technique deployed in the binary fish school search (BFSS). Additionally, the authors evaluate the proposal for feature selection for classification in well-known datasets. Moreover, the authors compare the performance of the proposal with a state-of-art algorithm called BMOPSO-CDR. MOBFSS presents better results than BMOPSO-CDR, especially for datasets with higher complexity.


Author(s):  
Abolfazl Seifi ◽  
Reza Hassannejad ◽  
Mohammad Ali Hamed

In this study, a new method to improve ride comfort, vehicle handling, and workspace was presented in multi-objective optimization using nonlinear asymmetrical dampers. The main aim of this research was to provide suitable passive suspension based on more efficiency and the low cost of the mentioned dampers. Using the model with five degrees of freedom, suspension system parameters were optimized under sinusoidal road excitation. The main functions of the suspension system were chosen as objective functions. In order to better illustrate the impact of each objective functions on the suspension parameters, at first two-objective and finally five-objective were considered in the optimization problem. The obtained results indicated that the optimized viscous coefficients for five-objective optimization lead to 3.58% increase in ride comfort, 0.74% in vehicle handling ability, and 2.20% in workspace changes for the average of forward and rear suspension.


Author(s):  
Damien Chablat ◽  
Ste´phane Caro ◽  
Raza Ur-Rehman ◽  
Philippe Wenger

This paper deals with the comparison of planar parallel manipulator architectures based on a multi-objective design optimization approach. The manipulator architectures are compared with regard to their mass in motion and their regular workspace size, i.e., the objective functions. The optimization problem is subject to constraints on the manipulator dexterity and stiffness. For a given external wrench, the displacements of the moving platform have to be smaller than given values throughout the obtained maximum regular dexterous workspace. The contributions of the paper are highlighted with the study of 3-PRR, 3-RPR and 3-RRR planar parallel manipulator architectures, which are compared by means of their Pareto frontiers obtained with a genetic algorithm.


2022 ◽  
Author(s):  
Shogo Hayashi ◽  
Junya Honda ◽  
Hisashi Kashima

AbstractBayesian optimization (BO) is an approach to optimizing an expensive-to-evaluate black-box function and sequentially determines the values of input variables to evaluate the function. However, it is expensive and in some cases becomes difficult to specify values for all input variables, for example, in outsourcing scenarios where production of input queries with many input variables involves significant cost. In this paper, we propose a novel Gaussian process bandit problem, BO with partially specified queries (BOPSQ). In BOPSQ, unlike the standard BO setting, a learner specifies only the values of some input variables, and the values of the unspecified input variables are randomly determined according to a known or unknown distribution. We propose two algorithms based on posterior sampling for cases of known and unknown input distributions. We further derive their regret bounds that are sublinear for popular kernels. We demonstrate the effectiveness of the proposed algorithms using test functions and real-world datasets.


2021 ◽  
Author(s):  
Israel Mayo-Molina ◽  
Juliana Y. Leung

Abstract The Steam Alternating Solvent (SAS) process has been proposed and studied in recent years as a new auspicious alternative to the conventional thermal (steam-based) bitumen recovery process. The SAS process incorporates steam and solvent (e.g. propane) cycles injected alternatively using the same configuration as the Steam-Assisted Gravity-Drainage (SAGD) process. The SAS process offers many advantages, including lower capital and operational cost, as well as a reduction in water usage and lower Greenhouse Gas (GHG) Emissions. On the other hand, one of the main challenges of this relatively new process is the influence of uncertain reservoir heterogeneity distribution, such as shale barriers, on production behaviour. Many complex physical mechanisms, including heat transfer, fluid flows, and mass transfer, must be coupled. A proper design and selection of the operational parameters must consider several conflicting objectives. This work aims to develop a hybrid multi-objective optimization (MOO) framework for determining a set of Pareto-optimal SAS operational parameters under a variety of heterogeneity scenarios. First, a 2-D homogeneous reservoir model is constructed based on typical Cold lake reservoir properties in Alberta, Canada. The homogeneous model is used to establish a base scenario. Second, different shale barrier configurations with varying proportions, lengths, and locations are incorporated. Third, a detailed sensitivity analysis is performed to determine the most impactful parameters or decision variables. Based on the results of the sensitivity analysis, several objective functions are formulated (e.g., minimizing energy and solvent usage). Fourth, Response Surface Methodology (RSM) is applied to generate a set of proxy models to approximate the non-linear relationship between the decision variables and the objective functions and to reduce the overall computational time. Finally, three Multi-Objective Evolutionary Algorithms (MOEAs) are applied to search and compare the optimal sets of decision parameters. The study showed that the SAS process is sensitive to the shale barrier distribution, and that impact is strongly dependent on the location and length of a specific shale barrier. When a shale barrier is located near the injector well, pressure and temperature may build up in the near-well area, preventing additional steam and solvent be injected and, consequently, reducing the oil production. Operational constraints, such as bottom-hole pressure, steam trap criterion, and bottom-hole gas rate in the producer, are among various critical decision variables examined in this study. A key conclusion is that the optimal operating strategy should depend on the underlying heterogeneity. Although this notion has been alluded to in other previous steam- or solvent-based studies, this paper is the first to utilize a MOO framework for systematically determining a specific optimal strategy for each heterogeneity scenario. With the advancement of continuous downhole fibre-optic monitoring, the outcomes can potentially be integrated into other real-time reservoir characterization and optimization work-flows.


Author(s):  
Reza Tajik

Nowadays, various issues regarding the power quality have been widely considered. Regarding to the progress made in power electronics in recent years, the best way to improve the reliability of reducing voltage deviations, reducing losses, and generally providing high quality to consumers is to use custom power devices (CPDs). Series, parallel, or hybrid devices come from a subset of CPDs such as a dynamic voltage restorer, distribution static compensator, and unified power quality conditioner. In this work, the purpose of place these devices are to achieve various goals of improving power quality and reducing system costs. To achieve these goals, at first, the problem of single-objective optimization for each of the objective functions was solved separately. After determining the optimal value of each of the objective functions, the fuzzy membership functions for each of the objective functions were suitably optimized for each objective function. A mixed integer genetic algorithm was used to find the optimal answer to this multi-objective problem. The simulation results show that the proposed algorithm has worked well to find the optimal solution. The results of multi-objective planning proposed in this study show that with proper planning, it can be done at a low cost and even with a relatively high profit to cost and with the proper place of CPDs, to solve issues related to power quality issues in distribution networks.


Sign in / Sign up

Export Citation Format

Share Document