Asymptotic normality of a projective estimator of an infinite-dimensional parameter of nonlinear regression

1993 ◽  
Vol 45 (9) ◽  
pp. 1348-1359
Author(s):  
A. G. Kukush
Keyword(s):  
Asymptotic Normality ◽  
Nonlinear Regression ◽  
Dimensional Parameter ◽  
Infinite Dimensional

CONSISTENCY AND ASYMPTOTIC NORMALITY OF SIEVE ML ESTIMATORS UNDER LOW-LEVEL CONDITIONS

2014 ◽  
Vol 30 (5) ◽  
pp. 1021-1076 ◽  
Author(s):  
Herman J. Bierens
Keyword(s):  
Asymptotic Normality ◽  
Density Function ◽  
Choice Model ◽  
Likelihood Estimation ◽  
Dimensional Parameter ◽  
Infinite Dimensional ◽  
Low Level ◽  
Asymptotically Normal ◽  
Finite Dimensional ◽  
Image Position

This paper considers sieve maximum likelihood estimation of seminonparametric (SNP) models with an unknown density function as non-Euclidean parameter, next to a finite-dimensional parameter vector. The density function involved is modeled via an infinite series expansion, so that the actual parameter space is infinite-dimensional. It will be shown that under low-level conditions the sieve estimators of these parameters are consistent, and the estimators of the Euclidean parameters are$\sqrt N$asymptotically normal, given a random sample of sizeN. The latter result is derived in a different way than in the sieve estimation literature. It appears that this asymptotic normality result is in essence the same as for the finite dimensional case. This approach is motivated and illustrated by an SNP discrete choice model.

hIPPYlib

2021 ◽  
Vol 47 (2) ◽  
pp. 1-34
Author(s):  
Umberto Villa ◽  
Noemi Petra ◽  
Omar Ghattas
Keyword(s):  
Inverse Problems ◽  
Large Scale ◽  
Low Rank ◽  
Scalable Algorithms ◽  
Low Rank Approximation ◽  
Dimensional Parameter ◽  
Infinite Dimensional ◽  
Bayesian Inverse Problems ◽  
Rank Approximation ◽  
Extensible Software

We present an extensible software framework, hIPPYlib, for solution of large-scale deterministic and Bayesian inverse problems governed by partial differential equations (PDEs) with (possibly) infinite-dimensional parameter fields (which are high-dimensional after discretization). hIPPYlib overcomes the prohibitively expensive nature of Bayesian inversion for this class of problems by implementing state-of-the-art scalable algorithms for PDE-based inverse problems that exploit the structure of the underlying operators, notably the Hessian of the log-posterior. The key property of the algorithms implemented in hIPPYlib is that the solution of the inverse problem is computed at a cost, measured in linearized forward PDE solves, that is independent of the parameter dimension. The mean of the posterior is approximated by the MAP point, which is found by minimizing the negative log-posterior with an inexact matrix-free Newton-CG method. The posterior covariance is approximated by the inverse of the Hessian of the negative log posterior evaluated at the MAP point. The construction of the posterior covariance is made tractable by invoking a low-rank approximation of the Hessian of the log-likelihood. Scalable tools for sample generation are also discussed. hIPPYlib makes all of these advanced algorithms easily accessible to domain scientists and provides an environment that expedites the development of new algorithms.

On a Problem of Estimation of Infinite-Dimensional Parameter

2016 ◽  
Vol 219 (5) ◽  
pp. 731-742
Author(s):  
V. A. Ershov ◽  
I. A. Ibragimov
Keyword(s):  
Dimensional Parameter ◽  
Infinite Dimensional

scholarly journals Robust estimation and inference for general varying coefficient models with missing observations

Test ◽  
2019 ◽  
Vol 29 (4) ◽  
pp. 966-988
Author(s):  
Francesco Bravo
Keyword(s):  
Nonlinear Least Squares ◽  
Missing At Random ◽  
Varying Coefficient Models ◽  
Finite Sample ◽  
Dimensional Parameter ◽  
Infinite Dimensional ◽  
Varying Coefficient ◽  
Finite Sample Properties ◽  
Local Linear Estimation ◽  
Nonlinear Least Squares Estimation

AbstractThis paper considers estimation and inference for a class of varying coefficient models in which some of the responses and some of the covariates are missing at random and outliers are present. The paper proposes two general estimators—and a computationally attractive and asymptotically equivalent one-step version of them—that combine inverse probability weighting and robust local linear estimation. The paper also considers inference for the unknown infinite-dimensional parameter and proposes two Wald statistics that are shown to have power under a sequence of local Pitman drifts and are consistent as the drifts diverge. The results of the paper are illustrated with three examples: robust local generalized estimating equations, robust local quasi-likelihood and robust local nonlinear least squares estimation. A simulation study shows that the proposed estimators and test statistics have competitive finite sample properties, whereas two empirical examples illustrate the applicability of the proposed estimation and testing methods.

Regression for randomly sampled spatial series: the trigonometric case

1986 ◽  
Vol 23 (A) ◽  
pp. 275-289 ◽  
Author(s):  
David R. Brillinger
Keyword(s):  
Maximum Likelihood ◽  
Asymptotic Normality ◽  
Point Process ◽  
Maximum Likelihood Estimates ◽  
Dimensional Parameter ◽  
Finite Dimensional ◽  
Spatial Series ◽  
Consistency And Asymptotic Normality ◽  
Image Position ◽  
Asymptotically Efficient

The model Y(t) = s(t | θ) + ε(t) is studied in the case that observations are made at scattered points τ j in a subset of Rp and θ is a finite-dimensional parameter. The particular cases of 0 = (α, β) and (α, β, ω) are considered in detail. Consistency and asymptotic normality results are developed assuming that the spatial series ε(·) and the point process {τ j} are independent, stationary and mixing. The estimates considered are equivalent to least squares asymptotically and are not generally asymptotically efficient.Contributions of the paper include: study of the Rp case, management of irregularly placed observations, allowance for abnormal domains of observation and the discovery that aliasing complications do not arise when the point process {τ j} is mixing. There is a brief discussion of the construction and properties of maximum likelihood estimates for the spatial-temporal case.

Sign in / Sign up

Export Citation Format

Share Document