Enhancing the Performance of the Distributed Gauss-Newton Optimization Method by Reducing the Effect of Numerical Noise and Truncation Error With Support-Vector Regression

SPE Journal ◽  
2018 ◽  
Vol 23 (06) ◽  
pp. 2428-2443 ◽  
Author(s):  
Zhenyu Guo ◽  
Chaohui Chen ◽  
Guohua Gao ◽  
Jeroen Vink

Summary Numerical optimization is an integral part of many history-matching (HM) workflows. However, the optimization performance can be affected negatively by the numerical noise existent in the forward models when the gradients are estimated numerically. As an unavoidable part of reservoir simulation, numerical noise refers to the error caused by the incomplete convergence of linear or nonlinear solvers or truncation errors caused by different timestep cuts. More precisely, the allowed solver tolerances and allowed changes of pressure and saturation imply that simulation results no longer smoothly change with changing model parameters. For HM with linear-distributed Gaussian-Newton (L-DGN), caused by the discontinuity of simulation results, the sensitivity matrix computed by linear interpolation might be less accurate, which might result in slow convergence or, even worse, failure of convergence. Recently, we have developed an HM workflow by integrating the support-vector regression (SVR) with the distributed-Gaussian-Newton (DGN) method optimization method referred to as SVR-DGN. Unlike L-DGN that computes the sensitivity matrix with a simple linear proxy, SVR-DGN computes the sensitivity matrix by taking the gradient of the SVR proxies. In this paper, we provide theoretical analysis and case studies to show that SVR-DGN can compute a more-accurate sensitivity matrix than L-DGN, and SVR-DGN is insensitive to the negative influence of numerical noise. We also propose a cost-saving training procedure by replacing bad-training points, which correspond to relatively large values of the objective function, with those training-data points (simulation data) that have smaller values of the objective function and are generated at most-recent iterations for training the SVR proxies. Both the L-DGN approach and the newly proposed SVR-DGN approach are tested first with a 2D toy problem to show the effect of numerical noise on their convergence performance. We find that their performance is comparable when the toy problem is free of numerical noise. As the numerical-noise level increases, the performance of the L-DGN degrades sharply. By contrast, the SVR-DGN performance is quite stable. Then, both methods are tested using a real-field HM example. The convergence performance of the SVR-DGN is quite robust for both the tight and loose numerical settings, whereas the performance of the L-DGN degrades significantly when loose numerical settings are applied.

2021 ◽  
Author(s):  
Yixuan Wang ◽  
Faruk Alpak ◽  
Guohua Gao ◽  
Chaohui Chen ◽  
Jeroen Vink ◽  
...  

Abstract Although it is possible to apply traditional optimization algorithms to determine the Pareto front of a multi-objective optimization problem, the computational cost is extremely high, when the objective function evaluation requires solving a complex reservoir simulation problem and optimization cannot benefit from adjoint-based gradients. This paper proposes a novel workflow to solve bi-objective optimization problems using the distributed quasi-Newton (DQN) method, which is a well-parallelized and derivative-free optimization (DFO) method. Numerical tests confirm that the DQN method performs efficiently and robustly. The efficiency of the DQN optimizer stems from a distributed computing mechanism which effectively shares the available information discovered in prior iterations. Rather than performing multiple quasi-Newton optimization tasks in isolation, simulation results are shared among distinct DQN optimization tasks or threads. In this paper, the DQN method is applied to the optimization of a weighted average of two objectives, using different weighting factors for different optimization threads. In each iteration, the DQN optimizer generates an ensemble of search points (or simulation cases) in parallel and a set of non-dominated points is updated accordingly. Different DQN optimization threads, which use the same set of simulation results but different weighting factors in their objective functions, converge to different optima of the weighted average objective function. The non-dominated points found in the last iteration form a set of Pareto optimal solutions. Robustness as well as efficiency of the DQN optimizer originates from reliance on a large, shared set of intermediate search points. On the one hand, this set of searching points is (much) smaller than the combined sets needed if all optimizations with different weighting factors would be executed separately; on the other hand, the size of this set produces a high fault tolerance. Even if some simulations fail at a given iteration, DQN’s distributed-parallel information-sharing protocol is designed and implemented such that the optimization process can still proceed to the next iteration. The proposed DQN optimization method is first validated on synthetic examples with analytical objective functions. Then, it is tested on well location optimization problems, by maximizing the oil production and minimizing the water production. Furthermore, the proposed method is benchmarked against a bi-objective implementation of the MADS (Mesh Adaptive Direct Search) method, and the numerical results reinforce the auspicious computational attributes of DQN observed for the test problems. To the best of our knowledge, this is the first time that a well-parallelized and derivative-free DQN optimization method has been developed and tested on bi-objective optimization problems. The methodology proposed can help improve efficiency and robustness in solving complicated bi-objective optimization problems by taking advantage of model-based search optimization algorithms with an effective information-sharing mechanism.


2010 ◽  
Vol 44-47 ◽  
pp. 3746-3751
Author(s):  
Qing Wu

This paper presents a new smooth approach to solve support vector regression (SVR). Based on Karush-Kuhn-Tucker complementary condition in optimization theory, a smooth unconstrained optimization model for SVR is built. Since the objective function of the unconstrained SVR model is non-smooth, we apply the smooth techniques and replace the ε-insensitive loss function by CHKS function. Newton-Armijo algorithm is used to solve the smooth CHKS-SSVR model. Primary numerical results illustrate that our proposed approach improves the regression performance and the learning efficiency.


2015 ◽  
Vol 119 (1222) ◽  
pp. 1541-1560 ◽  
Author(s):  
S. Manso

AbstractThis paper provides an overview of techniques developed for the application of support vector regression in the domain of simulation and system identification of helicopter dynamics. A generic high fidelity FLIGHTLAB helicopter model is used to train and validate a number of pitch response SVR models. These models are then trained using flight data from a Sikorsky Seahawk helicopter. The SVR simulation results show significant promise in the ability to represent aspects of a helicopter’s dynamics at a high fidelity. To achieve this, it is important to provide the SVR kernel with knowledge of past inputs that encompass the delay characteristics of the helicopter dynamic system. In this case, the use of nonlinear auto regressive eXogenous input network architecture achieves this goal. Good performance was achieved using input data that encompassed between 300 to 500ms worth of historic response.


2021 ◽  
Vol 9 ◽  
Author(s):  
Zhaoyang Qu ◽  
Miao Li ◽  
Zhenming Zhang ◽  
Mingshi Cui ◽  
Yuguang Zhou

Aiming at the problem of insufficient accuracy and timeliness of transmission line parameters in the grid energy management system (EMS) parameter library, a dynamic optimization method of transmission line parameters based on grey support vector regression is proposed. Firstly, the influence of operating conditions and meteorological factors on the changes of parameters is analyzed. Based on this, the correlation quantification method of transmission line parameters is designed based on Pearson coefficient, and the influence coefficient value is obtained. Then, with the influence coefficient as the constraint condition, a method for selecting strong influence characteristics of line parameters based on improved Elastic Net is proposed. Finally, based on the grey prediction theory, a grey support vector regression (GM-SVR) parameter optimization model is constructed to realize the dynamic optimization of line parameter values under the power grid operation state. The effectiveness and feasibility of the proposed method is verified through the commissioning of the reactance parameters of the actual local loop network transmission line.


2021 ◽  
Author(s):  
Huizhon LIU ◽  
Keshun YOU

Abstract In order to better improve the efficiency of the concentrate filter press dehydration operation, this paper studies the mechanism and optimization methods of the filter press dehydration process. Machine learning models of RBF-OLS, RBF-GRNN and support vector regression (SVR) are constructed respectively, and Perform laboratory simulation and industrial simulation separately. SVR achieves the best accuracy in industrial simulation, the simulated mean relative error (MRE) of moisture and processing capacity are respectively 1.57% and 3.81%. Finally, a simulation model of the filter press dehydration process established by SVR, and the optimtical simulation results Obtained by optimization method based on control variables. The results show that the machine learning method of SVR and optimization methods based on control variables are applied to industry, which can not only ensure the stability of expected production indicators, but also shorten the filter press dehydration cycle to less than 85% of the original.


2014 ◽  
Vol 494-495 ◽  
pp. 1364-1367 ◽  
Author(s):  
Jin Gang Jiang ◽  
Tian Hua He ◽  
Ye Dai ◽  
Yong De Zhang

During the manufacture of complete denture, the most important step is to design and generate the dental arch curve which adapts to the requirement of patients according to the jaw arch morphology of them. It is important to study the optimization method of the number and position of control point for the dental arch generator. On the basis of motion analysis of the dental arch generator, objective function, multivariate design and constraint function of control point optimization of dental arch generator is determined. Control points number and position of the dental arch generator is optimized. Simulation results verify the feasibility of control point optimization method.


Sign in / Sign up

Export Citation Format

Share Document