Journals / European Journal of Pure and Applied Mathematics (elektronik) / 2011 / Cilt: 4 - Sayı: 4

Predictive subset selection using regression trees and RBF neural networks hybridized with the genetic algorithm

Pages
467–485
Publication Date
2022-10-18
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

On the other hand, estimation and prediction performance of model also taken into account for best subset chosen. 2000 Mathematics Subject Classifications: 62G08; 62J02; 17-08; 62B10; 62-07

📌 3 Key Takeaways

🎯
Objective & Hypothesis:In this paper we develop a novel nonparametric predictive subset regression modeling procedure that involves a combination of regression trees with radial basis function (RBF) neural networks hybridized with the genetic algorithm (GA) to carry out the subset selection of the best predictors.
📊
Key Findings & Data:We use the information-theoretic measure of complexity (ICOMP) criterion of [5, 6, 7, 8] as our fitness function to choose the best approximating radial basis functions and to choose the best subset of predictors with the GA.
💡
Conclusion & Impact:On the other hand, estimation and prediction performance of model also taken into account for best subset chosen. 2000 Mathematics Subject Classifications: 62G08; 62J02; 17-08; 62B10; 62-07
🔬Design:Modeling & Simulation
📍Scope:2000 Verileri
⚙️Variables:Domain Parameters

Abstract

In this paper we develop a novel nonparametric predictive subset regression modeling procedure that involves a combination of regression trees with radial basis function (RBF) neural networks hybridized with the genetic algorithm (GA) to carry out the subset selection of the best predictors. We use the information-theoretic measure of complexity (ICOMP) criterion of [5, 6, 7, 8] as our fitness function to choose the best approximating radial basis functions and to choose the best subset of predictors with the GA. To avoid the potential singularities in the design matrix, we combine our model with analytical global ridge regression for regularization. On the other hand, estimation and prediction performance of model also taken into account for best subset chosen. 2000 Mathematics Subject Classifications: 62G08; 62J02; 17-08; 62B10; 62-07

🔖

Cite This Article

BOZDOGAN, H., AKBILGIC, O. (2022). Predictive subset selection using regression trees and RBF neural networks hybridized with the genetic algorithm. European Journal of Pure and Applied Mathematics (elektronik), Cilt: 4 - Sayı: 4, 467–485. https://ajindex.com/articles/511288

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (16)

  1. H Akaike. Information theory and an extension of the maximum likelihood principle. In B Petrox and F Csaki, editors, Second International Symposium on Information Theory., pages 267–281, Budapest, 1973. Academiai Kiado
  2. C Bishop. Improving the generalization properties of radial basis function neural networks. Neural Computation, 3:579–588, 1991
  3. D Boyce, A Fahri, and R Weischedel. Optimal Subset Selection: Multiple Regression, Independence, and Optimal Network Algorithms Extension. Springer Verlag, New York, 1974
  4. H Bozdogan. Model selection and Akaike’s information criterion (AIC): The general theory and it’s analytical extension. Journal of Mathematical Psychology, 52:345–370, September 1987
  5. H Bozdogan. Icomp: A new model-selection criteria. In H.H Bock, editor, Classification and Related Methods of Data Analysis. 1988
  6. H Bozdogan. Mixture-model cluster analysis using a new informational complexity and model selection criteria. In H Bozdogan, editor, Multivariate Statistical Modeling, Vol. 2, Proceedings of the First US/Japan Conference on the Frontiers of Statistical Modeling: An Informational Approach, pages 69–113. Kluwer Academic Publishers, The Netherlands, Dordrecht, 1994
  7. H Bozdogan. Akaike’s information criterion and recent developments in informational complexity. Journal of Mathematical Psychology, 44:62–91, March 2000
  8. H Bozdogan. Intelligent statistical data mining with information complexity and genetic algorithms. In H Bozdogan, editor, Statistical Data Mining and Knowledge Discovery, pages 15–56. Chapman and Hall/CRC, Boca Raton, Florida, 2004
  9. L Breiman, J Freidman, J C Stone, and R Olsen. Classification and Regression Trees. Chapman and Hall, 1984
  10. R Hocking. Developments in linear regression methodology: 1959-1982. Technometrics, 25:219–230, 1983
  11. A Horel, R Kennard, and K Baldwin. Ridge regression: Some simulations. Communica- tions in Statistics, 4:105–123, 1975
  12. M Kubat. Decision trees can initialize radial basis function networks. Transactions on Neural Networks, 9:813–821, 1998
  13. A Kullback and R Leibler. On information and sufficiency. Annals of Mathematical Statis- tics, 22:79–86, 1951
  14. J Lawless and P Wang. A simulation study if ridge and other regression estimators. Communications in Statistics, A5:307–323, 1975
  15. C Lin and C Lee. Neural Fuzzy Systems; A Neuro-Fuzzy Synergism to Intelligent Systems. Prentice Hall P T R, New Jersey, USA, 1996
  16. D MacKay. A pra