Journals / International Journal of Intelligent Systems and Applications in Engineering / 2020 / Cilt: 8 - Sayı: 4

Recurrent Neural Networks for Spam E-mail Classification on an Agglutinative Language

Pages
221–227
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

It turns out that WMI and MI with deep learning architectures seem more robust to spam email detection when considering the high detection scores.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:In this study, we have provided an alternative solution to spam and legitimate email classification problem.
📊
Key Findings & Data:Finally, the performance of system is analyzed with using Artificial Neural Network (ANN), Long Short-Term Memory (LSTM) and Bidirectional Long Short-Term Memory (BILSTM) models.
💡
Conclusion & Impact:It turns out that WMI and MI with deep learning architectures seem more robust to spam email detection when considering the high detection scores.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Özet

In this study, we have provided an alternative solution to spam and legitimate email classification problem. The different deep learning architectures are applied on two feature selection methods, including the Mutual Information (MI) and Weighted Mutual Information (WMI). Firstly, feature selection methods including WMI and MI are applied to reduce number of selected terms. Secondly, the feature vectors are constructed with concept of the bag-of-words (BoW) model. Finally, the performance of system is analyzed with using Artificial Neural Network (ANN), Long Short-Term Memory (LSTM) and Bidirectional Long Short-Term Memory (BILSTM) models. After experimental simulations, we have observed that there is a competition between detection results of using WMI and MI when commented with accuracy rates for the agglutinative language, namely Turkish. The experimental scores show that the LSTM and BILSTM give 100% accuracy scores when combined with MI or WMI, for spam and legitimate emails. However, for particular cross validation, the performance WMI is higher than MI features in terms e-mail grouping. It turns out that WMI and MI with deep learning architectures seem more robust to spam email detection when considering the high detection scores.

🔖

Cite This Article

IŞIK, Ş., KURT, Z., ANAGUN, Y., ÖZKAN, K. (2020). Recurrent Neural Networks for Spam E-mail Classification on an Agglutinative Language. International Journal of Intelligent Systems and Applications in Engineering, Cilt: 8 - Sayı: 4, 221–227. https://ajindex.com/articles/199688

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (11)

  1. A. K. Uysal, S. Gunal, S. Ergin, and E. S. Gunal, "A novel framework for SMS spam filtering," in 2012 International Symposium on Innovations in Intelligent Systems and Applications, 2012, pp. 1-4
  2. L. Özgür, T. Güngör, and F. Gürgen, "Adaptive anti-spam filtering for agglutinative languages: a special case for Turkish," Pattern Recognition Letters, vol. 25, no. 16, pp. 1819-1831, 2004
  3. A. Uysal, S. Gunal, S. Ergin, and E. Sora Gunal, "The Impact of Feature Extraction and Selection on SMS Spam Filtering," Elektronika ir Elektrotechnika, vol. 19, no. 5, pp. 67-72, 2012. [4] usa.kaspersky.com. (2020). Spam and Phishing Statistics Report Q1-2014, [Online]. Available: https://usa.kaspersky.com/resource-center/threats/spam-statistics-report-q1-2014, Accessed: Dec. 11, 2020. [5] itgovarnance.eu. (2020). Kaspersky records 130 million phishing attacks in Q2 2019, [Online]. Available: https://www.itgovernance.eu/, Accessed: Dec. 11, 2020
  4. S. Gunal, "Hybrid feature selection for text classification," Turkish Journal of Electrical Engineering Computer Sciences, vol. 20, no. 2, pp. 1296-1311, 2012
  5. S. Ergin and S. Isik, "The assessment of feature selection methods on agglutinative language for spam email detection: A special case for Turkish," in Innovations in Intelligent Systems and Applications (INISTA) Proceedings, 2014 IEEE International Symposium on, 2014, pp. 122-125
  6. S. Ergin and S. Isik, "The investigation on the effect of feature vector dimension for spam email detection with a new framework," in Information Systems and Technologies (CISTI), 2014 9th Iberian Conference on, 2014, pp. 1-4
  7. W. Fang, H. Luo, S. Xu, P. E. Love, Z. Lu, and C. Ye,"Automated text classification of near-misses from safety reports: An improved deep learning approach," Advanced Engineering Informatics, vol. 44, p. 101060, 2020
  8. A. Elnagar, R. Al-Debsi, and O. Einea, "Arabic text classification using deep learning models," Information Processing Management, vol. 57, no. 1, p. 102121, 2020
  9. A. Abdi, S. M. Shamsuddin, S. Hasan, and J. Piran, "Deep learning-based sentiment classification of evaluative text based on Multi-feature fusion," Information Processing Management, vol. 56, no. 4, pp. 1245-1259, 2019
  10. P. K. Roy, J. P. Singh, and S. Banerjee, "Deep learning to filter SMS spam," Future Generation Computer Systems, vol. 102, pp. 524-533, 2020
  11. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural computation, vol. 9, no. 8, pp.