Journals / Süleyman Demirel Üniversitesi Fen Bilimleri Enstitüsü Dergisi / 2018 / Cilt: 22 - Sayı: 1

Performance of a New Restricted Biased Estimator in Logistic Regression

Pages
53–59
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

According to the results, proposed estimator has better performance than MLE, RMLE and LTE.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:It is known that the variance of the maximum likelihood estimator (MLE) inflates when the explanatory variables are correlated.
📊
Key Findings & Data:A Monte Carlo experiment is designed to evaluate the performances of the proposed estimator, the restricted MLE (RMLE), MLE and Liu-type estimator (LTE).
💡
Conclusion & Impact:According to the results, proposed estimator has better performance than MLE, RMLE and LTE.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Estimation · Liu-type estimator · MLE

Özet

It is known that the variance of the maximum likelihood estimator (MLE) inflates when the explanatory variables are correlated. This situation is called the multicollinearity problem. As a result, the estimations of the model may not be trustful. Therefore, this paper introduces a new restricted estimator (RLTE) that may be applied to get rid of the multicollinearity when the parameters lie in some linear subspace in logistic regression. The mean squared errors (MSE) and the matrix mean squared errors (MMSE) of the estimators considered in this paper are given. A Monte Carlo experiment is designed to evaluate the performances of the proposed estimator, the restricted MLE (RMLE), MLE and Liu-type estimator (LTE). The criterion of performance is chosen to be MSE. Moreover, a real data example is presented. According to the results, proposed estimator has better performance than MLE, RMLE and LTE.

🔖

Cite This Article

ASAR, Y. (2018). Performance of a New Restricted Biased Estimator in Logistic Regression. Süleyman Demirel Üniversitesi Fen Bilimleri Enstitüsü Dergisi, Cilt: 22 - Sayı: 1, 53–59. https://ajindex.com/articles/309985

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (17)

  1. Asar, Y. 2017. Some new methods to solve multicollinearity in logistic regression. Communications in Statistics-Simulation and Computation, 46(4) 2576-2586
  2. Arashi, M., Kibria, B. M. G., Norouzirad, M., Nadarajah, S. 2014. Improved preliminary test and Stein-rule Liu estimators for the ill-conditioned elliptical linear regression model. Journal Multivariate Analysis. 126 53–74
  3. Asar, Y., Genç, A. 2016. New shrinkage parameters for the Liu-type logistic estimators. Communications in Statistics-Simulation and Computation, 45(3) 1094-1103
  4. Belsley, D. A., Kuh, E.,Welsch, R.E. 1980. Regression diagnostics: Identifying influential data and sources of collinearity. Wiley, New York
  5. Cox, D. R., Snell, E. J. 1989. Analysis of Binary Data (2nd ed.): Chapman & Hall
  6. Duffy, D. E., Santner, T. J. 1989. On the small sample properties of norm-restricted maximum likelihood estimators for logistic regression models. Communications in Statistics-Theory and Methods, 18(3) 959-980
  7. Hoerl, A. E., Kennard, R. W. 1970. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1) 55-67
  8. Hoerl, A. E., Kennard, R. W., Baldwin, K. F. 1975. Ridge regression: some simulations. Communications in Statistics-Theory and Methods, 4(2) 105-123
  9. Hosmer, D.D., Lemeshow, S., Sturdivant, R.X. 2013. Applied Logistic Regression. Hoboken, New Jersey: John Wiley & Sons
  10. İnan, D., Erdoğan, B. E. 2013. Liu-Type Logistic Estimator. Communications in Statistics-Simulation and Computation, 42(7) 1578-1586
  11. LeCessie, S., VanHouwelingen, J.C. 1992. Ridge estimators in logistic regression. Applied Statistics 41(1) 191-201
  12. Liu, K. 1993. A new class of blased estimate in linear regression. Communications in Statistics-Theory and Methods, 22(2) 393-402
  13. Liu, K. 2003. Using Liu-type estimator to combat collinearity. Communications in Statistics-Theory and Methods, 32(5), 1009-1020
  14. Kibria, B. M. G. 2003. Performance of some new ridge regression estimators. Communications in Statistics-Simulation and Computation, 32(2) 419-435
  15. Mansson, K., Kibria, B. M. G., Shukur, G. 2012. On Liu estimators for the logit regression model. Economic Modelling, 29(4) 1483-1488
  16. Mansson, K., and Shukur, G. 2011.On Ridge Parameters in Logistic Regression. Communications in Statistics-Theory and Methods, 40(18) 366-3381
  17. Mansson, K., Kibria, B. M. G., Shukur, G. 2016. A restricted Liu estimator for binary regression models and its