Dergiler / Turkish Journal of Electrical Engineering and Computer Science / 2012 / Cilt: 20 - Sayı: 3
Performance comparison of new nonparametric independent component analysis algorithm for different entropic indexes
- Sayfa
- 287–297
- DOI
- —
Özet
Most independent component analysis (ICA) algorithms use mutual information (MI) measures based on Shannon entropy as a cost function, but Shannon entropy is not the only measure in the literature. In this paper, instead of Shannon entropy, Tsallis entropy is used and a novel ICA algorithm, which uses kernel density estimation (KDE) for estimation of source distributions, is proposed. KDE is directly evaluated from the original data samples, so it solves the important problem in ICA: how to choose nonlinear functions as the probability density function (pdf) estimation of the sources.
Abstract
Most independent component analysis (ICA) algorithms use mutual information (MI) measures based on Shannon entropy as a cost function, but Shannon entropy is not the only measure in the literature. In this paper, instead of Shannon entropy, Tsallis entropy is used and a novel ICA algorithm, which uses kernel density estimation (KDE) for estimation of source distributions, is proposed. KDE is directly evaluated from the original data samples, so it solves the important problem in ICA: how to choose nonlinear functions as the probability density function (pdf) estimation of the sources.