Journals / Journal of New Theory / 2022 / Cilt: - Sayı: 40

Random Ensemble MARS: Model Selection in Multivariate Adaptive Regression Splines Using Random Forest Approach

Pages
27–45
Publication Date
2022-11-06
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The MARS model, which works better in the larger data set, provides more reliable results with smaller data sets utilising the proposed method.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Multivariate Adaptive Regression Splines (MARS) is a supervised learning model in machine learning, not obtained by an ensemble learning method.
📊
Key Findings & Data:This study presented REMARS (Random Ensemble MARS), a new MARS model selection approach obtained using the Random Forest (RF) algorithm. 200 training and test data set generated via the Bagging method were analysed in the MARS analysis engine.
💡
Conclusion & Impact:The MARS model, which works better in the larger data set, provides more reliable results with smaller data sets utilising the proposed method.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Multivariate Adaptive Regression Splines · Random Forest · Model Selection

Abstract

Multivariate Adaptive Regression Splines (MARS) is a supervised learning model in machine learning, not obtained by an ensemble learning method. Ensemble learning methods are gathered from samples comprising hundreds or thousands of learners that serve the common purpose of improving the stability and accuracy of machine learning algorithms. This study presented REMARS (Random Ensemble MARS), a new MARS model selection approach obtained using the Random Forest (RF) algorithm. 200 training and test data set generated via the Bagging method were analysed in the MARS analysis engine. At the end of the analysis, two different MARS model sets were created, one yielding the smallest Mean Square Error for the test data (Test MSE) and the other yielding the smallest Generalised Cross-Validation (GCV) value. The best model was estimated for both Test MSE and GCV criteria by examining the error of measurement criteria, variable importance averages, and frequencies of the knot values for each model. Eventually, a new model was obtained via the ensemble learning method, i.e., REMARS, that yields result as good as the MARS model obtained from the original data set. The MARS model, which works better in the larger data set, provides more reliable results with smaller data sets utilising the proposed method.

🔖

Cite This Article

SABANCI, D., CENGİZ, M. A. (2022). Random Ensemble MARS: Model Selection in Multivariate Adaptive Regression Splines Using Random Forest Approach. Journal of New Theory, Cilt: - Sayı: 40, 27–45. https://ajindex.com/articles/652514

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (15)

  1. S. Theodoridis, Machine Learning a Bayesian and Optimisation Perspective, Academic Press of Elsevier, 125 London Wall, London, 2015.
  2. S. Suthaharan, Machine Learning Models and Algorithms for Big Data Classification, Springer International Publishing, New York, 2016.
  3. T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning: Data Mining, Inference and Prediction, Springer Series in Statistics, Stanford, California, 2001.
  4. T. K. Ho, Random Decision Forests, Proceedings of 3rd International Conference on Document Analysis and Recognition (IEEE), Montreal, Canada, 1995, pp. 278–282.
  5. T. K. Ho, The Random Subspace Method for Constructing Decision Forests, IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (2) (1998) 832–844.
  6. T. Hill, P. Lewicki, Statistics: Methods and Applications, StatSoft, Tulsa OK, 2006.
  7. J. R. Leathwick, J. Elith, T. Hastie, Comparative Performance of Generalised Additive Models and Multivariate Adaptive Regression Splines for Statistical Modelling of Species Distributions, Ecological Modelling 199 (2) (2006) 188–196.
  8. D. Yao, J. Yang, X. Zhan, A Novel Method for Disease Prediction: Hybrid of Random Forest and Multivariate Adaptive Regression Splines, Journal of Computers 8 (1) (2013) 170–177.
  9. L. Kumar, S. K. Rath, Quality Assessment of Web Services Using Multivariate Adaptive Regression Splines, in: J. Sun, Y. R. Reddy, A. Bahulkar, A. Pasala (Eds.), 22nd Asia-Pacific Software Engineering Conference, New Delhi, India, 2015, pp. 238–245.
  10. W. Zhang, A. T. Goh, Multivariate Adaptive Regression Splines and Neural Network Models for Prediction of Pile Drivability, Geoscience Frontiers 7 (1) (2016) 45–52.
  11. P. Dey, A. K. Das, Application of Multivariate Adaptive Regression Spline-Assisted Objective Function on Optimisation of Heat Transfer Rate Around a Cylinder, Nuclear Engineering and Technology 48 (6) (2016) 1315–1320.
  12. Y. J. Chen, J. A. Lın, Y. M. Chen, J. H. Wu, Financial Forecasting with Multivariate Adaptive Regression Splines and Queen Genetic Algorithm-Support Vector Regression. IEEE Access 7 (2019) 112931–112938.
  13. J. Pittman, Adaptive Splines and Genetic Algorithms, Journal of Computational and Graphical Statistics 11 (3) (2002) 615–638.
  14. G. W. Weber, I. Batmaz, G. Köksal, P. Taylan, F. Y. Özkurt, CMARS: A New Contribution to Nonparametric Regression with Multivariate Adaptive Regression Splines Supported by Continuous Optimisation, Inverse Problems in Science and Engineering 20 (3) (2012) 371–400.
  15. A. Özmen, G.