Dergiler / Turkish Journal of Electrical Engineering and Computer Science / 2010 / Cilt: 18 - Sayı: 6

Using covariates for improving the minimum redundancy maximum relevance feature selection method

Sayfa
975–989
Yayın Tarihi
2010-06-01
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

The experimental results show that instead of feeding the features themselves into mRMR, feeding the covariates improves the feature selection capability and provides more expressive variable subsets.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:Maximizing the joint dependency with a minimum size of variables is generally the main task of feature selection.
📊
Temel Bulgular & Veri:For obtaining a minimal subset, while trying to maximize the joint dependency with the target variable, the redundancy among selected variables must be reduced to a minimum.
💡
Sonuç & Katkı:The experimental results show that instead of feeding the features themselves into mRMR, feeding the covariates improves the feature selection capability and provides more expressive variable subsets.
🔬Tür:Araştırma Makalesi
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Mutual information · mRMR · unsupervised learning

Özet

Maximizing the joint dependency with a minimum size of variables is generally the main task of feature selection. For obtaining a minimal subset, while trying to maximize the joint dependency with the target variable, the redundancy among selected variables must be reduced to a minimum. In this paper, we propose a method based on recently popular minimum Redundancy-Maximum Relevance} (mRMR) criterion. The experimental results show that instead of feeding the features themselves into mRMR, feeding the covariates improves the feature selection capability and provides more expressive variable subsets.

Abstract

Maximizing the joint dependency with a minimum size of variables is generally the main task of feature selection. For obtaining a minimal subset, while trying to maximize the joint dependency with the target variable, the redundancy among selected variables must be reduced to a minimum. In this paper, we propose a method based on recently popular minimum Redundancy-Maximum Relevance} (mRMR) criterion. The experimental results show that instead of feeding the features themselves into mRMR, feeding the covariates improves the feature selection capability and provides more expressive variable subsets.

🔖

Bu Makaleye Atıf Yap

KURŞUN, O., ŞAKAR, C. O., FAVOROV, O. (2010). Using covariates for improving the minimum redundancy maximum relevance feature selection method. Turkish Journal of Electrical Engineering and Computer Science, Cilt: 18 - Sayı: 6, 975–989. https://ajindex.com/articles/188815

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (5)

  1. J. G. Zhang, & H.W. Deng, “Gene selection for classiŞcation of microarray data based on the Bayes error”, BMC Bioinformatics, Vol. 8, pp. 370, 2007. C. E. Shannon, “A mathematical theory of communication”, Bell System Technical Journal, Vol. 27, pp. 379-423, 656, 1948. C. Ding & H. Peng, “Minimum redundancy feature selection from microarray gene expression data”, Journal of Bioinformatics and Computational Biology, Vol. 3(2), pp. 185-205, 2005. N. Kwak & C. H. Choi, “Input feature selection by mutual information based on Parzen Window”, IEEE Transac- tions on Pattern Analysis and Machine Intelligence, Vol. 24(12), pp. 1667-1671, 2002.
  2. H. Peng, F. Long, F., C. Ding, “Feature selection based on mutual information: Criteria of max-dependency, max- relevance, and min-redundancy”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27(8), pp. 1238, 2005. UCI Learning Repository, http://archive.ics.uci.edu/ml/, June 2008.
  3. H. Ozdemir, G. Demir, G. Altay, S. Albayrak, C. Bayat, “Prediction of tropospheric ozone concentration in Istanbul by employing artiŞcial neural network”, Environmental Engineering Science, Vol. 25(9), 2008. P. A. Est´evez, M. Tesmer, C. A. Perez, J. M. Zurada, “Normalized mutual information feature selection”, IEEE Transactions on Neural Networks, Vol. 20(2), 2009. O. Favorov & D. Ryder, “SINBAD: a neocortical mechanism for discovering environmental variables and regularities hidden in sensory input”, Biological Cybernetics, Vol. 90, pp. 191-202, 2004. O. Kursun & O. Favorov, “Feature selection and extraction using an unsupervised biologically-suggested approxi- mation to Gebelein’s maximal correlation”, International Journal of Pattern Recognition and ArtiŞcial Intelligence, (to appear). O. Kursun & O. Favorov, “SINBAD automation of scientiŞc discovery: From factor analysis to theory synthesis”, Natural Computing, Vol. 3(2), pp. 207-233, 2004. O. Kursun & O. Favorov, “What can SVMS teach each other?”, ArtiŞcial Neural Networks in Engineering (ANNIE ), St Louis, MO, USA, 2004. A. Bal, “Widrow-cellular neural network and optoelectronic implementation”, Optik, Vol. 115, pp. 295-300, 2004.
  4. C. Fyfe, Hebbian Learning and Negative Feedback Networks, Springer, 2005. C. W. Hsu & C. J. Lin, “A comparison of methods for multi-class support vector machines”, IEEE Trans. Neural Networks, Vol. 13, pp. 415-425, (LIBSVM software available for downloading at http://www.csie.ntu.edu.tw/∼cjlin/libsvm).
  5. M. A. Little, P. E. McSharry, E. J. Hunte