Journals / Hacettepe Journal of Mathematics and Statistics / 2021 / Cilt: 50 - Sayı: 1

Robust regression estimation and variable selection when cellwise and casewise outliers are present

Pages
289–303
Publication Date
2022-10-18
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The simulation results and real data example revealed that the proposed estimation and variable selection procedure perform well in the presence of cellwise and casewise outliers.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Two main issues regarding a regression analysis are estimation and variable selection in presence of outliers.
📊
Key Findings & Data:Popular robust regression estimation methods are combined with variable selection methods to simultaneously achieve robust estimation and variable selection.
💡
Conclusion & Impact:The simulation results and real data example revealed that the proposed estimation and variable selection procedure perform well in the presence of cellwise and casewise outliers.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Robust Variable Selection · Outliers · Cellwise Outlier

Abstract

Two main issues regarding a regression analysis are estimation and variable selection in presence of outliers. Popular robust regression estimation methods are combined with variable selection methods to simultaneously achieve robust estimation and variable selection. However, recent works showed that the robust estimation methods used in those estimation and variable selection procedures are only resistant to the casewise (rowwise) outliers in the data. Therefore, since these robust variable selection methods may not be able to cope with cellwise outliers in the data, some extra care should be taken when cellwise outliers are present along with the casewise outliers. In this study, we proposed a robust estimation and variable selection method to deal with both cellwise and casewise outliers in the data. The proposed method has three steps. In the first step, cellwise outliers were identified, deleted and marked with NA sign in each explanatory variable. In the second step, the cells with NA signs were imputed using a robust imputation method. In the last step, robust regression estimation methods were combined with the variable selection method LASSO (Least Angle Solution and Selection Operator) to estimate the regression parameters and to select remarkable explanatory variables. The simulation results and real data example revealed that the proposed estimation and variable selection procedure perform well in the presence of cellwise and casewise outliers.

🔖

Cite This Article

Toka, O., Çetin, M., Arslan, O. (2022). Robust regression estimation and variable selection when cellwise and casewise outliers are present. Hacettepe Journal of Mathematics and Statistics, Cilt: 50 - Sayı: 1, 289–303. https://ajindex.com/articles/529537

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (17)

  1. C. Agostinelli, A. Leung, V.J. Yohai and R.H. Zamar, Robust estimation of multivariate location and scatter in the presence of cellwise and casewise contamination, Test, 24 (3), 441-461, 2015
  2. F. Alqallaf, S. Van Aelst, V.J. Yohai and R.H. Zamar, Propagation of Outliers in Multivariate Data, Ann. Statist. 37 (1), 311-331, 2009
  3. O. Arslan, Weighted LAD-LASSO method for robust parameter estimation and variable selection in regression, Comput. Statist. Data Anal. 56 (6), 1952-1965, 2012
  4. O. Arslan, Penalized MM regression estimation with L γ penalty: a robust version of bridge regression, Statistics 50 (6), 1236-1260, 2016
  5. K.V. Branden and S. Verboven, Robust data imputation, Comput. Biol. Chem. 33 (1), 7-13, 2009
  6. M. Danilov, Robust estimation of multivariate scatter in non-affine equivariant scenarios, University of British Columbia, 2010
  7. M. Debruyne, S. Höppner, S. Serneels and T. Verdonck, Outlyingness: Which variables contribute most?, Stat. Comput. 29 (4), 707-723, 2019
  8. J. Fan, Y. Fan and E. Barut, Adaptive robust variable selection, Ann. Statist. 42 (1), 324-351, 2014
  9. A. Farcomeni, Snipping for robust k-means clustering under component-wise contamination, Stat. Comput. 24 (6), 907-919, 2014
  10. P.A. Ferrari, P. Annoni, A. Barbiero and G. Manzi, An imputation method for categorical variables with application to nonlinear principal component analysis, Comput. Statist. Data Anal. 55 (7), 2410-2420, 2011
  11. A.E. Hoerl and R.W. Kennard, Ridge regression Biased estimation for nonorthogonal problems, Technometrics 12 (1), 55-67, 1970
  12. A. Leung, H. Zhang and R. Zamar, Robust regression estimation and inference in the presence of cellwise and casewise contamination, Comput. Statist. Data Anal. 99, 1-11, 2016
  13. A. Leung, V. Yohai and R. Zamar, Multivariate location and scatter matrix estimation under cellwise and casewise contamination, Comput. Statist. Data Anal. 111, 59-76, 2017
  14. J. Machkour, B. Alt, M. Muma and A.M. Zoubir, The outlier-corrected-data-adaptive Lasso: A new robust estimator for the independent contamination model, 25th European Signal Processing Conference (EUSIPCO), IEEE, 1649-1653, 2017
  15. R.A. Maronna, Robust ridge regression for high-dimensional data, Technometrics 53 (1), 44-53, 2011
  16. R.A. Maronna, R.D. Martin, V.J. Yohai and S.B. Matías, Robust statistics: theory and methods (with R), John Wiley & Sons, 2019
  17. V. Ollerer, A. Andreas and C. Croux, The shooting S-estimat