Journals / Hacettepe Journal of Mathematics and Statistics / 2017 / Cilt: 46 - Sayı: 5

Review and classi cations of the ridge parameter estimation techniques

Pages
953–967
Publication Date
2022-10-18
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Investigationof the existing and proposed ones were done by conducting1000 Monte-Carlo experiments under five (5) levels of multicollinearity(ρ = 0.8, 0.9, 0.95, 0.99, 0.999), three (3) levels of error variance(σ2 = 0.25, 1, 25) and ve levels of sample size (n = 10, 20, 30, 40, 50).The relative eciency (RF ≤ 0.75) of the techniques resulting from theratio of their mean square error and that of the ordinary least squarewas used to compare the techniques.Results show that the proposed techniques perform better than the existingones in some situations; and that the best technique is generallythe ridge parameter in the form of Harmonic Mean, Fixed Maximumand Varying Maximum in their Original and Square Root types.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Ridge parameter estimation techniques under the inffuence of multicollinearityin Linear regression model were reviewed and classiffed intodifferent forms and various types.
📊
Key Findings & Data:The different forms are Fixed Maximum(FM), Varying Maximum (VM), Arithmetic Mean (AM), GeometricMean (GM), Harmonic Mean (HM) and Median (M) and thevarious types are Original (O), Reciprocal (R), Square Root (SR) andReciprocal of Square Root (RSR).
💡
Conclusion & Impact:Investigationof the existing and proposed ones were done by conducting1000 Monte-Carlo experiments under five (5) levels of multicollinearity(ρ = 0.8, 0.9, 0.95, 0.99, 0.999), three (3) levels of error variance(σ2 = 0.25, 1, 25) and ve levels of sample size (n = 10, 20, 30, 40, 50).The relative eciency (RF ≤ 0.75) of the techniques resulting from theratio of their mean square error and that of the ordinary least squarewas used to compare the techniques.Results show that the proposed techniques perform better than the existingones in some situations; and that the best technique is generallythe ridge parameter in the form of Harmonic Mean, Fixed Maximumand Varying Maximum in their Original and Square Root types.
🔬Design:Review & Systematic Survey
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Abstract

Ridge parameter estimation techniques under the inffuence of multicollinearityin Linear regression model were reviewed and classiffed intodifferent forms and various types. The different forms are Fixed Maximum(FM), Varying Maximum (VM), Arithmetic Mean (AM), GeometricMean (GM), Harmonic Mean (HM) and Median (M) and thevarious types are Original (O), Reciprocal (R), Square Root (SR) andReciprocal of Square Root (RSR). These classiffcations resulted intoproposing some other techniques of Ridge parameter estimation. Investigationof the existing and proposed ones were done by conducting1000 Monte-Carlo experiments under five (5) levels of multicollinearity(ρ = 0.8, 0.9, 0.95, 0.99, 0.999), three (3) levels of error variance(σ2 = 0.25, 1, 25) and ve levels of sample size (n = 10, 20, 30, 40, 50).The relative eciency (RF ≤ 0.75) of the techniques resulting from theratio of their mean square error and that of the ordinary least squarewas used to compare the techniques.Results show that the proposed techniques perform better than the existingones in some situations; and that the best technique is generallythe ridge parameter in the form of Harmonic Mean, Fixed Maximumand Varying Maximum in their Original and Square Root types.

🔖

Cite This Article

LUKMAN, A. F., AYİNDE, K. (2022). Review and classi cations of the ridge parameter estimation techniques. Hacettepe Journal of Mathematics and Statistics, Cilt: 46 - Sayı: 5, 953–967. https://ajindex.com/articles/529905

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (13)

  1. Wichern, D. and Churchill, G. (1978). A Comparison of Ridge Estimators. Technometrics, 20, 301-311.
  2. Vinod, D. and Ullah, A. (1981). Recent Advances in Regression Methods, Marcel Dekker Inc. Publication. Saleh, A. K. Md. E. and Kibria, B. M. G. (1993). Performances of some new preliminary test ridge regression estimators and their properties. Communications in Statistics-Theory and Methods, 22, 2747-2764.
  3. Muniz, G., Kibria, B.M.G., Mansson, K., Shukur, G. (2012). On Developing Ridge Regression Parameters: A Graphical Investigation. SORT. 36(2), 115-138.
  4. Muniz, G. and Kibria, B. M. G. (2009). On some ridge regression estimators: An empirical comparison. Communications in Statistics-Simulation and Computation, 38, 621-630.
  5. McDonald, G. C. and Galarneau, D. I. (1975). A Monte Carlo evaluation of some ridge-type estimators. Journal of the American Statistical Association, 70, 407-416.
  6. Mardikyan, S. and Cetin, E. (2008). E cient Choice of Biasing Constant for Ridge Regression, Int.J. Contemp.Math.Sciences, 3, 527-547.
  7. Mansson, K., Shukur, G. and Kibria, B. M. G. (2010). A simulation study of some ridge regression estimators under dierent distributional assumptions. Communications in Statistics-Simulations and Computations, 39(8), 1639 1670. Lukman, A. F (2015): Review and classi cation of the Ridge Parameter Estimation Techniques. Ladoke Akintola University of Technology, Ogbomoso, Oyo State, Nigeria. Unpublished P.hD. Thesis. Lawless, J. F. and Wang, P. (1976). A simulation study of ridge and other regression estimators. Communications in Statistics A, 5, 307-323.
  8. Kibria, B. M. G. (2003). Performance of some new ridge regression estimators. Communications in Statistics-Simulation and Computation, 32, 419-435.
  9. Khalaf, G. and Shukur, G. (2005). Choosing ridge parameters for regression problems. Communications in Statistics- Theory and Methods, 34, 1177-1182.
  10. Hoerl, A. E., Kennard, R. W. and Baldwin, K. F. (1975). Ridge regression: Some simulation. Communications in Statistics 4 (2), 105123. Gujarati, D.N.(1995).
  11. Basic Econometrics, McGraw-Hill, New York. Hoerl, A.E. and Kennard, R.W. (1970). Ridge regression: biased estimation for nonorthogonal problems. Technometrics, 12, 55-67.
  12. Gibbons, D. G. (1981). A simulation study of some ridge estimators. Journal of the American Statistical Association, 76, 131-139.
  13. Alkhamisi, M., Khalaf, G. and Shukur, G. (2006). Some modiffcations for choosing ridge parameters.Communications in Statistics- Theory and Methods, 35(11),