SavedAdd your journal

Journals / Politeknik Dergisi / 2021 / Cilt: 24 - Sayı: 4

Intrusion Detection Model Based on TF.IDF and C4.5 Algorithms

Khaldoon AWADH
Ayhan AKBAŞ
Pages
1691–1698
Publication Date
2021-12-01
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The increase in accuracy reflects the efficiency of transforming the dataset with TF.IDF of various segment sizes.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:In recent years, the use of machine learning and data mining technologies has drawn researchers’ attention to new ways to improve the performance of Intrusion Detection Systems (IDS).
📊
Key Findings & Data:In this paper, we present an IDS model based on the decision tree C4.5 algorithm with transforming simulated UNSW-NB15 dataset as a pre-processing operation.
💡
Conclusion & Impact:The increase in accuracy reflects the efficiency of transforming the dataset with TF.IDF of various segment sizes.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:IDS · TF.IDF · Data Mining

Abstract

In recent years, the use of machine learning and data mining technologies has drawn researchers’ attention to new ways to improve the performance of Intrusion Detection Systems (IDS). These techniques have proven to be an effective method in distinguishing malicious network packets. One of the most challenging problems that researchers are faced with is the transformation of data into a form that can be handled effectively by Machine Learning Algorithms (MLA). In this paper, we present an IDS model based on the decision tree C4.5 algorithm with transforming simulated UNSW-NB15 dataset as a pre-processing operation. Our model uses Term Frequency.Inverse Document Frequency (TF.IDF) to convert data types to an acceptable and efficient form for machine learning to achieve high detection performance. The model has been tested with randomly selected 250000 records of the UNSW-NB15 dataset. Selected records have been grouped into various segment sizes, like 50, 500, 1000, and 5000 items. Each segment has been, further, grouped into two subsets of multi and binary class datasets. The performance of the Decision Tree C4.5 algorithm with Multilayer Perceptron (MLP) and Naive Bayes (NB) has been compared in Weka software. Our proposed method significantly has improved the accuracy of classifiers and decreased incorrectly detected instances. The increase in accuracy reflects the efficiency of transforming the dataset with TF.IDF of various segment sizes.

Özet

In recent years, the use of machine learning and data mining technologies has drawn researchers’ attention to new ways to improve the performance of Intrusion Detection Systems (IDS). These techniques have proven to be an effective method in distinguishing malicious network packets. One of the most challenging problems that researchers are faced with is the transformation of data into a form that can be handled effectively by Machine Learning Algorithms (MLA). In this paper, we present an IDS model based on the decision tree C4.5 algorithm with transforming simulated UNSW-NB15 dataset as a pre-processing operation. Our model uses Term Frequency.Inverse Document Frequency (TF.IDF) to convert data types to an acceptable and efficient form for machine learning to achieve high detection performance. The model has been tested with randomly selected 250000 records of the UNSW-NB15 dataset. Selected records have been grouped into various segment sizes, like 50, 500, 1000, and 5000 items. Each segment has been, further, grouped into two subsets of multi and binary class datasets. The performance of the Decision Tree C4.5 algorithm with Multilayer Perceptron (MLP) and Naive Bayes (NB) has been compared in Weka software. Our proposed method significantly has improved the accuracy of classifiers and decreased incorrectly detected instances. The increase in accuracy reflects the efficiency of transforming the dataset with TF.IDF of various segment sizes.

🔖

Cite This Article

AWADH, K., AKBAŞ, A. (2021). Intrusion Detection Model Based on TF.IDF and C4.5 Algorithms. Politeknik Dergisi, Cilt: 24 - Sayı: 4, 1691–1698. https://ajindex.com/articles/422205

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (18)

  1. Yu Z. Intrusion Detection: A Machine Learning Approach (Volume 3). London, UK: Imperial College Press, 2011.
  2. Armin J, Thompson B, Ariu D, Giacinto G, Roli F, Kijewski P. 2020 cybercrime economic costs: No measure no solution. In: 10th International Conference on Availability, Reliability and Security (ARES); 24-27 Aug. 2015;
  3. Toulouse, France. New York, NY, USA: IEEE. pp.701-710.
  4. Bhattacharyya DK, Kalita JK. Network anomaly detection: A machine learning perspective. New York, NY, USA: CRC Press, 2013.
  5. Katkar VD, Bhatia DS. Lightweight approach for detection of denial of service attacks using numeric to binary preprocessing. In: IEEE International Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA); 4-5 April 2014;
  6. Mumbai, India. New York, NY, USA: IEEE. pp. 207-212.
  7. Mehmood T, Rais H. Machine learning algorithms in context of intrusion detection. In: IEEE 2016 Computer and Information Sciences (ICCOINS), International Conference; 15-17 Aug. 2016;
  8. Kuala Lumpur, Malaysia. New York, NY, USA: IEEE. pp. 369-373.
  9. Mane D, Pawar S. Anomaly based IDS using Backpropagation Neural Network. International Journal of Computer Applications 2016; 136: 29-34.
  10. Deshmukh DH, Ghorpade T, Padiya P. Intrusion detection system by improved preprocessing methods and Naive Bayes classifier using NSL-KDD 99 Dataset. In: IEEE 2014 International Conference on Electronics and Communication Systems (ICECS); 13-14 Feb. 2014;
  11. Coimbatore, India. New York, NY, USA: IEEE. pp. 1-7.
  12. Mogal DG, Ghungrad SR, Bhusare BB. NIDS using Machine Learning Classifiers on UNSW-NB15 and KDDCUP99 Datasets. International Journal of Advanced Research in Computer and Communication Engineering 2017; 6: 533-537.
  13. Dadgar SMH, Araghi MS, Farahani MM. A novel text mining approach based on TF-IDF and Support Vector Machine for news classification. In: IEEE 2016 International Conference on Engineering and Technology (ICETECH); 17-18 March 2016;
  14. Coimbatore, India. New York, NY, USA: IEEE. pp. 112-116.
  15. Manning CD, Raghavan P, Schütze H. An Introduction to Information Retrieval. England: Cambridge University Press, 2009.
  16. Leskovec J, Rajaraman A, Ullman JD. Mining of massive datasets. 5th ed. England: Cambridge University Press, 2014. Aggarwal CC. Data mining: the textbook. New York, USA: Springer, 2015.
  17. Zaki MJ, Meira W. Data mining and analysis: fundamental concepts and algorithms. 1st ed. New York, USA: Cambridge University Press, 2014.
  18. Moustafa N, Slay J. The significant featu