The estimated parameter of logistic regression model by Markov Chain Monte Carlo method with multicollinearity

2020 ◽  
Vol 36 (4) ◽  
pp. 1253-1259
Author(s):  
Autcha Araveeporn ◽  
Yuwadee Klomwises

Markov Chain Monte Carlo (MCMC) method has been a popular method for getting information about probability distribution for estimating posterior distribution by Gibbs sampling. So far, the standard methods such as maximum likelihood and logistic ridge regression methods have represented to compare with MCMC. The maximum likelihood method is the classical method to estimate the parameter on the logistic regression model by differential the loglikelihood function on the estimator. The logistic ridge regression depends on the choice of ridge parameter by using crossvalidation for computing estimator on penalty function. This paper provides maximum likelihood, logistic ridge regression, and MCMC to estimate parameter on logit function and transforms into a probability. The logistic regression model predicts the probability to observe a phenomenon. The prediction accuracy evaluates in terms of the percentage with correct predictions of a binary event. A simulation study conducts a binary response variable by using 2, 4, and 6 explanatory variables, which are generated from multivariate normal distribution on the positive and negative correlation coefficient or called multicollinearity problem. The criterion of these methods is to compare by a maximum of predictive accuracy. The outcomes find that MCMC satisfies all situations.

2018 ◽  
Vol 48 (3) ◽  
pp. 199-204 ◽  
Author(s):  
R. LI ◽  
J. ZHOU ◽  
L. WANG

In this paper, the non-parametric bootstrap and non-parametric Bayesian bootstrap methods are applied for parameter estimation in the binary logistic regression model. A real data study and a simulation study are conducted to compare the Nonparametric bootstrap, Non-parametric Bayesian bootstrap and the maximum likelihood methods. Study results shows that three methods are all effective ways for parameter estimation in the binary logistic regression model. In small sample case, the non-parametric Bayesian bootstrap method performs relatively better than the non-parametric bootstrap and the maximum likelihood method for parameter estimation in the binary logistic regression model.


2019 ◽  
Vol 4 (2) ◽  
pp. 100
Author(s):  
Catrin Muharisa ◽  
Ferra Yanuar ◽  
Hazmira Yozza

Analisis regresi merupakan salah satu metode untuk melihat hubungan antara variabel bebas (independent) dengan variabel terikat (dependent) yang dinyatakan dalam model regresi. Beberapa metode yang bisa digunakan untuk mengestimasi parameter model regresi, diantaranya adalah metode klasik dan metode Bayes. Salah satu metode klasik adalah metode maximum likelihood. Penelitian ini membahas tentang perbandingan metode maximum likelihood dan metode Bayes dalam mengestimasi parameter model regresi linear berganda untuk data berdistribusi normal. Adapun rumus untuk mengestimasi parameter dengan metode maximum likelihood adalah βˆ=(XTX)-1XTY dan ˆσ2 = 1 n P∞ k=1 ei. Sedangkan untuk mengestimasi parameter dengan metode Bayes adalah dengan menggunakan distribusi prior dan fungsi likelihood. Distribusi prior yag dipilih pada kajian ini adalah f(β, σ2 ) = Qn i=1 f(βj |σ 2 )f(σ 2 ) dengan βj ∼ N(µβj , σ2 ) dan σ 2 ∼ IG(a, b). Distribusi prior konjugat tersebut kemudian dikalikan dengan fungsi likelihood L(β, σ2 ) sehingga membentuk distribusi posterior f(β|σ 2 ). Distribusi posterior inilah yang digunakan untuk mengestimasi parameter model melalui proses Markov Chain Monte Carlo (MCMC). Algoritma MCMC yang digunakan adalah algoritma Gibbs Sampler. Model regresi linear berganda yang diperoleh dengan metode maximum likelihood adalahyˆ = −27, 8210000 + 0, 0307430X1 + 0, 0039211X2 + 0, 0034631X3 + 0, 6537000X4dengan kecocokan modelnya adalah sebesar 95,7 %. Sedangkan model regresi linear berganda yang diperoleh dengan metode Bayes adalahyˆ = −26, 620000 + 0, 029380X1 + 0, 004204X2 + 0, 003321X3 + 0, 656200X4dengan kecocokan modelnya adalah sebesar 99,99 %. Dengan demikian dapat disimpulkan bahwa metode Bayes lebih baik dari pada metode maximum likelihood.Kata Kunci: Model Regresi Linear Berganda, metode Maximum Likelihood, dan metode Bayes


2021 ◽  
Vol 2106 (1) ◽  
pp. 012001
Author(s):  
P R Sihombing ◽  
S R Rohimah ◽  
A Kurnia

Abstract This study aims to compare the efficacy of logistic regression model for identifying the risk factors of low-birth-weight babies in Indonesia using the maximum likelihood estimation (MLE)and the Bayesian estimation methods. The data used in this study is secondary data derived from the 2017 Indonesian Demographic Health Survey with a total sample of 16,344 newborn babies. Selection of the best logistic regression model was based on the smaller Bayesian Schwartz Information Criterion (BIC) value. The logistic regression model with the Bayesian estimation method has a smaller BIC value than the MLE method. Twin births, baby girl, maternal age at risk, birth spacing that is too close, iron deficiency, low education, low economy, inadequate drinking water sources have provided a higher risk of low-birth-weight incidence.


2020 ◽  
Vol 67 (1) ◽  
pp. 5-32
Author(s):  
Barbara Pawełek ◽  
Jadwiga Kostrzewska ◽  
Maciej Kostrzewski ◽  
Krzysztof Gałuszka

The aim of this paper is to present the results of an assessment of the financial condition of companies from the construction industry after the announcement of arrangement bankruptcy, in comparison to the condition of healthy companies. The logistic regression model estimated by means of the maximum likelihood method and the Bayesian approach were used. The first achievement of our study is the assessment of the financial condition of companies from the construction industry after the announcement of bankruptcy. The second achievement is the application of an approach combining the classical and Bayesian logistic regression models to assess the financial condition of companies in the years following the declaration of bankruptcy, and the presentation of the benefits of such a combination. The analysis described in the paper, carried out in most part by means of the ML logistic regression model, was supplemented with information yielded by the application of the Bayesian approach. In particular, the analysis of the shape of the posterior distribution of the repeat bankruptcy probability makes it possible, in some cases, to observe that the financial condition of a company is not clear, despite clear assessments made on the basis of the point estimations.


Sign in / Sign up

Export Citation Format

Share Document