Using Maximum Likelihood Estimation to Estimate Kriging Model Parameters

Author(s):  
Jay D. Martin

A kriging model can be used as a surrogate to a more computationally expensive model or simulation. It is capable of providing a continuous mathematical relationship that can interpolate a set of observations. One of the major issues with using kriging models is the potentially computationally expensive process of estimating the best model parameters. One of the most common methods used to estimate model parameters is Maximum Likelihood Estimation (MLE). MLE of kriging model parameters requires the use of numerical optimization of a continuous but possibly multi-modal log-likelihood function. This paper presents some enhancements to gradient-based methods to make them more computationally efficient and compares the potential reduction in computational burden. These enhancements include the development of the analytic gradient and Hessian for the log-likelihood equation of a kriging model that uses a Gaussian spatial correlation function. The suggested algorithm is very similar to the Scoring algorithm traditionally used in statistics, a Newton-Raphson gradient-based optimization method.

2009 ◽  
Vol 131 (8) ◽  
Author(s):  
Jay D. Martin

The details of a method to reduce the computational burden experienced while estimating the optimal model parameters for a Kriging model are presented. A Kriging model is a type of surrogate model that can be used to create a response surface based a set of observations of a computationally expensive system design analysis. This Kriging model can then be used as a computationally efficient surrogate to the original model, providing the opportunity for the rapid exploration of the resulting tradespace. The Kriging model can provide a more complex response surface than the more traditional linear regression response surface through the introduction of a few terms to quantify the spatial correlation of the observations. Implementation details and enhancements to gradient-based methods to estimate the model parameters are presented. It concludes with a comparison of these enhancements to using maximum likelihood estimation to estimate Kriging model parameters and their potential reduction in computational burden. These enhancements include the development of the analytic gradient and Hessian for the log-likelihood equation of a Kriging model that uses a Gaussian spatial correlation function. The suggested algorithm is similar to the SCORING algorithm traditionally used in statistics.


2012 ◽  
Vol 12 (9&10) ◽  
pp. 775-790
Author(s):  
Douglas S. Goncalves ◽  
Marcia A. Gomes-Ruggiero ◽  
Carlile Lavor ◽  
Osvaldo J. Farias ◽  
P. H. Souto Ribeiro

Maximum likelihood estimation is one of the most used methods in quantum state tomography, where the aim is to reconstruct the density matrix of a physical system from measurement results. One strategy to deal with positivity and unit trace constraints is to parameterize the matrix to be reconstructed in order to ensure that it is physical. In this case, the negative log-likelihood function in terms of the parameters, may have several local minima. In various papers in the field, a source of errors in this process has been associated to the possibility that most of these local minima are not global, so that optimization methods could be trapped in the wrong minimum, leading to a wrong density matrix. Here we show that, for convex negative log-likelihood functions, all local minima of the unconstrained parameterized problem are global, thus any minimizer leads to the maximum likelihood estimation for the density matrix. We also discuss some practical sources of errors.


2019 ◽  
Vol 36 (10) ◽  
pp. 2352-2357
Author(s):  
David A Shaw ◽  
Vu C Dinh ◽  
Frederick A Matsen

Abstract Maximum likelihood estimation in phylogenetics requires a means of handling unknown ancestral states. Classical maximum likelihood averages over these unknown intermediate states, leading to provably consistent estimation of the topology and continuous model parameters. Recently, a computationally efficient approach has been proposed to jointly maximize over these unknown states and phylogenetic parameters. Although this method of joint maximum likelihood estimation can obtain estimates more quickly, its properties as an estimator are not yet clear. In this article, we show that this method of jointly estimating phylogenetic parameters along with ancestral states is not consistent in general. We find a sizeable region of parameter space that generates data on a four-taxon tree for which this joint method estimates the internal branch length to be exactly zero, even in the limit of infinite-length sequences. More generally, we show that this joint method only estimates branch lengths correctly on a set of measure zero. We show empirically that branch length estimates are systematically biased downward, even for short branches.


2020 ◽  
pp. 2150018
Author(s):  
Zhifen Chen ◽  
Xiaopeng Chen

In this paper, we consider the maximum likelihood estimation for the symmetric [Formula: see text]-stable Ornstein–Uhlenbeck (S[Formula: see text]S-OU) processes based on discrete observations. Since the closed-form expression of maximum likelihood function is hard to obtain in the Lévy case, we choose a mixture of Cauchy and Gaussian distribution to approximate the probability density function (PDF) of the S[Formula: see text]S distribution. By means of transition function and Laplace transform, we construct an explicit approximate sequence of likelihood function, which converges to the likelihood function of S[Formula: see text]S distribution. Based on the approximation of likelihood function we give an algorithm for computing maximum likelihood estimation. We also numerically simulate some experiments which demonstrate the accuracy and stability of the proposed estimator.


2019 ◽  
Vol 2019 ◽  
pp. 1-8 ◽  
Author(s):  
Fan Yang ◽  
Hu Ren ◽  
Zhili Hu

The maximum likelihood estimation is a widely used approach to the parameter estimation. However, the conventional algorithm makes the estimation procedure of three-parameter Weibull distribution difficult. Therefore, this paper proposes an evolutionary strategy to explore the good solutions based on the maximum likelihood method. The maximizing process of likelihood function is converted to an optimization problem. The evolutionary algorithm is employed to obtain the optimal parameters for the likelihood function. Examples are presented to demonstrate the proposed method. The results show that the proposed method is suitable for the parameter estimation of the three-parameter Weibull distribution.


Sign in / Sign up

Export Citation Format

Share Document