A Berry-Esseen bound for least squares error variance estimators of regression parameters

1999 ◽  
Vol 39 (1) ◽  
pp. 1-7
Author(s):  
M. Bloznelis ◽  
A. Račkauskas
Keyword(s):  
Least Squares ◽  
Error Variance ◽  
Variance Estimators ◽  
Regression Parameters

scholarly journals Method of determining the distance to the object by analyzing its image blur

Vestnik MGSU ◽  
2015 ◽  
pp. 140-151 ◽  
Author(s):  
Aleksey Alekseevich Loktev ◽  
Daniil Alekseevich Loktev
Keyword(s):  
Least Squares ◽  
Statistical Approach ◽  
Evaluation Method ◽  
Least Squares Method ◽  
Focal Length ◽  
Error Variance ◽  
Method Of Least Squares ◽  
Automated Control ◽  
Image Blur

In modern integrated monitoring systems and systems of automated control of technological processes there are several essential algorithms and procedures for obtaining primary information about an object and its behavior. The primary information is characteristics of static and moving objects: distance, speed, position in space etc. In order to obtain such information in the present work we proposed to use photos and video detectors that could provide the system with high-quality images of the object with high resolution. In the modern systems of video monitoring and automated control there are several ways of obtaining primary data on the behaviour and state of the studied objects: a multisensor approach (stereovision), building an image perspective, the use of fixed cameras and additional lighting of the object, and a special calibration of photo or video detector.In the present paper the authors develop a method of determining the distances to objects by analyzing a series of images using depth evaluation using defocusing. This method is based on the physical effect of the dependence of the determined distance to the object on the image from the focal length or aperture of the lens. When focusing the photodetector on the object at a certain distance, the other objects both closer and farther than a focal point, form a spot of blur depending on the distance to them in terms of images. Image blur of an object can be of different nature, it may be caused by the motion of the object or the detector, by the nature of the image boundaries of the object, by the object’s aggregate state, as well as by different settings of the photo-detector (focal length, shutter speed and aperture).When calculating the diameter of the blur spot it is assumed that blur at the point occurs equally in all directions. For more precise estimates of the geometrical parameters determination of the behavior and state of the object under study a statistical approach is used to determine the individual parameters and estimate their accuracy. A statistical approach is used to evaluate the deviation of the dependence of distance from the blur from different types of standard functions (logarithmic, exponential, linear). In the statistical approach the evaluation method of least squares and the method of least modules are included, as well as the Bayesian estimation, for which it is necessary to minimize the risks under different loss functions (quadratic, rectangular, linear) with known probability density (we consider normal, lognormal, Laplace, uniform distribution). As a result of the research it was established that the error variance of a function, the parameters of which are estimated using the least squares method, will be less than the error variance of the method of least modules, that is, the evaluation method of least squares is more stable. Also the errors’ estimation when using the method of least squares is unbiased, whereas the mathematical expectation when using the method of least modules is not zero, which indicates the displacement of error estimations. Therefore it is advisable to use the least squares method in the determination of the parameters of the function.In order to smooth out the possible outliers we use the Kalman filter to process the results of the initial observations and evaluation analysis, the method of least squares and the method of least three standard modules for the functions after applying the filter with different coefficients.

scholarly journals PEMODELAN REGRESI RIDGE ROBUST-MM DALAM PENANGANAN MULTIKOLINIERITAS DAN PENCILAN (Studi Kasus : Faktor-Faktor yang Mempengaruhi AKB di Jawa Tengah Tahun 2017)

2019 ◽  
Vol 8 (1) ◽  
pp. 24-34
Author(s):  
Eka Destiyani ◽  
Rita Rahmawati ◽  
Suparti Suparti
Keyword(s):  
Least Squares ◽  
Robust Regression ◽  
Ordinary Least Squares ◽  
Regression Method ◽  
Predictor Variables ◽  
Healthy Life ◽  
Significance Level ◽  
Central Java ◽  
Regression Parameters

The Ordinary Least Squares (OLS) is one of the most commonly used method to estimate linear regression parameters. If multicollinearity is exist within predictor variables especially coupled with the outliers, then regression analysis with OLS is no longer used. One method that can be used to solve a multicollinearity and outliers problems is Ridge Robust-MM Regression. Ridge Robust-MM  Regression is a modification of the Ridge Regression method based on the MM-estimator of Robust Regression. The case study in this research is AKB in Central Java 2017 influenced by population dencity, the precentage of households behaving in a clean and healthy life, the number of low-weighted baby born, the number of babies who are given exclusive breastfeeding, the number of babies that receiving a neonatal visit once, and the number of babies who get health services. The result of estimation using OLS show that there is violation of multicollinearity and also the presence of outliers. Applied ridge robust-MM regression to case study proves ridge robust regression can improve parameter estimation. Based on t test at 5% significance level most of predictor variables have significant effect to variable AKB. The influence value of predictor variables to AKB is 47.68% and MSE value is 0.01538.Keywords:  Ordinary  Least  Squares  (OLS),  Multicollinearity,  Outliers,  RidgeRegression, Robust Regression, AKB.

Robust Weighted Least Squares Estimation of Regression Parameter in the Presence of Outliers and Heteroscedastic Errors

2014 ◽  
Vol 71 (1) ◽  
Author(s):  
Bello Abdulkadir Rasheed ◽  
Robiah Adnan ◽  
Seyed Ehsan Saffari ◽  
Kafi Dano Pati
Keyword(s):  
Linear Regression ◽  
Least Squares ◽  
Robust Regression ◽  
Weighted Least Squares ◽  
Ordinary Least Squares ◽  
Least Square ◽  
Model Parameters ◽  
Constant Variance ◽  
Regression Parameters ◽  
M Estimation

In a linear regression model, the ordinary least squares (OLS) method is considered the best method to estimate the regression parameters if the assumptions are met. However, if the data does not satisfy the underlying assumptions, the results will be misleading. The violation for the assumption of constant variance in the least squares regression is caused by the presence of outliers and heteroscedasticity in the data. This assumption of constant variance (homoscedasticity) is very important in linear regression in which the least squares estimators enjoy the property of minimum variance. Therefor e robust regression method is required to handle the problem of outlier in the data. However, this research will use the weighted least square techniques to estimate the parameter of regression coefficients when the assumption of error variance is violated in the data. Estimation of WLS is the same as carrying out the OLS in a transformed variables procedure. The WLS can easily be affected by outliers. To remedy this, We have suggested a strong technique for the estimation of regression parameters in the existence of heteroscedasticity and outliers. Here we apply the robust regression of M-estimation using iterative reweighted least squares (IRWLS) of Huber and Tukey Bisquare function and resistance regression estimator of least trimmed squares to estimating the model parameters of state-wide crime of united states in 1993. The outcomes from the study indicate the estimators obtained from the M-estimation techniques and the least trimmed method are more effective compared with those obtained from the OLS.

scholarly journals A Monograph on Nonlinear Regression Models

2018 ◽  
Vol 7 (4.10) ◽  
pp. 543
Author(s):  
B. Mahaboob ◽  
B. Venkateswarlu ◽  
C. Narayana ◽  
J. Ravi sankar ◽  
P. Balasiddamuni
Keyword(s):  
Regression Model ◽  
Least Squares ◽  
Nonlinear Regression ◽  
Nonlinear Models ◽  
Nonlinear Least Squares ◽  
Error Variance ◽  
Ordinary Least Squares ◽  
Parameter Estimates ◽  
Nonlinear Regression Model ◽  
Nonlinear Regression Models

This research article uses Matrix Calculus techniques to study least squares application of nonlinear regression model, sampling distributions of nonlinear least squares estimators of regression parametric vector and error variance and testing of general nonlinear hypothesis on parameters of nonlinear regression model. Arthipova Irina et.al [1], in this paper, discussed some examples of different nonlinear models and the application of OLS (Ordinary Least Squares). MA Tabati et.al (2), proposed a robust alternative technique to OLS nonlinear regression method which provide accurate parameter estimates when outliers and/or influential observations are present. Xu Zheng et.al [3] presented new parametric tests for heteroscedasticity in nonlinear and nonparametric models.  

scholarly journals Bayesian Model Averaging and Weighted-Average Least Squares: Equivariance, Stability, and Numerical Issues

2011 ◽  
Vol 11 (4) ◽  
pp. 518-544 ◽  
Author(s):  
Giuseppe De Luca ◽  
Jan R. Magnus
Keyword(s):  
Least Squares ◽  
Bayesian Model ◽  
Bayesian Model Averaging ◽  
Model Averaging ◽  
Weighted Average ◽  
Simulated Data ◽  
Linear Regression Models ◽  
Explanatory Variables ◽  
Memory Problems ◽  
Regression Parameters

In this article, we describe the estimation of linear regression models with uncertainty about the choice of the explanatory variables. We introduce the Stata commands bma and wals, which implement, respectively, the exact Bayesian model-averaging estimator and the weighted-average least-squares estimator developed by Magnus, Powell, and Prüfer (2010, Journal of Econometrics 154: 139–153). Unlike standard pretest estimators that are based on some preliminary diagnostic test, these model-averaging estimators provide a coherent way of making inference on the regression parameters of interest by taking into account the uncertainty due to both the estimation and the model selection steps. Special emphasis is given to several practical issues that users are likely to face in applied work: equivariance to certain transformations of the explanatory variables, stability, accuracy, computing speed, and out-of-memory problems. Performances of our bma and wals commands are illustrated using simulated data and empirical applications from the literature on model-averaging estimation.

Stein-rule estimation of coefficients for 18 eastern hardwood cubic volume equations

1986 ◽  
Vol 16 (2) ◽  
pp. 249-255 ◽  
Author(s):  
Edwin J. Green ◽  
William E. Strawderman
Keyword(s):  
Least Squares ◽  
Weighted Least Squares ◽  
Weighted Average ◽  
Total Sample ◽  
Ordinary Least Squares ◽  
Validation Data ◽  
Regression Parameters ◽  
Volume Equation ◽  
Mean Square Errors ◽  
Least Squares Estimates

A Stein-rule estimator, which shrinks least squares estimates of regression parameters toward their weighted average, was employed to estimate the coefficient in the constant form factor volume equation for 18 species simultaneously. The Stein-rule procedure was applied to ordinary least squares estimates and weighted least squares estimates. Simulation tests on independent validation data sets revealed that the Stein-rule estimates were biased, but predicted better than the corresponding least squares estimates. The Stein-rule procedures also yielded lower estimated mean square errors for the volume equation coefficient than the corresponding least squares procedure. Different methods of withdrawing sample data from the total sample available for each species revealed that the superiority of Stein-rule procedures over least squares decreased as the sample size increased and that the Stein-rule procedures were robust to unequal sample sizes, at least on the scale studied here.

scholarly journals VARIANCE PREDICTION FOR POPULATION SIZE ESTIMATION

2019 ◽  
Vol 38 (2) ◽  
pp. 131 ◽  
Author(s):  
Ana Isabel Gomez ◽  
Marcos Cruz ◽  
Luis Manuel Cruz-Orive
Keyword(s):  
Monte Carlo ◽  
Population Size ◽  
Error Variance ◽  
Unbiased Estimation ◽  
Mean Square ◽  
Size Estimation ◽  
Automatic Computer ◽  
Variance Estimators ◽  
Efficient Alternative ◽  
Mean Square Errors

Design unbiased estimation of population size by stereological methods is an efficient alternative to automatic computer vision methods, which are generally biased. Moreover, stereological methods offer the possibility of predicting the error variance from a single sample. Here we explore the statistical performance of two alternative variance estimators on a dataset of 26 labelled crowd pictures. The empirical mean square errors of the variance predictors are compared by means of Monte Carlo resampling.

Sign in / Sign up

Export Citation Format

Share Document