Journals / Adıyaman Üniversitesi Fen Bilimleri Dergisi / 2021 / Cilt: 11 - Sayı: 2

Optimization Based Undersampling for Imbalanced Classes

Dengesiz Sınıflamada Optimizasyona Dayalı Azörnekleme

Pages
385–409
Publication Date
2022-10-12
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

As a result, when undersampling, artificial bee colony was seen to perform better than other methods of optimization.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The classification methods consider the probability of predicting the majority class to be high when the number of class observations is different.
📊
Key Findings & Data:To address this problem, there are some methods such as resampling methods in the literature.
💡
Conclusion & Impact:As a result, when undersampling, artificial bee colony was seen to perform better than other methods of optimization.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Abstract

The classification methods consider the probability of predicting the majority class to be high when the number of class observations is different. To address this problem, there are some methods such as resampling methods in the literature. Undersampling, one of the resampling methods, creates balance by removing data from the majority class. This study aims to compare different optimization methods to determine the most suitable observations to be taken from the majority class while undersampling. Firstly, a simple simulation study was conducted and graphs were used to analyze the discrepancy between the resampled datasets. Then, different classifier models were constructed for different imbalanced data sets. In these models, random undersampling, undersampling with genetic algorithm, undersampling with differential evolution algorithm, undersampling with an artificial bee colony, and under-sampling with particle herd optimization were compared. The results were given rank numbers differing depending on the classifiers and data sets and a general mean rank was obtained. As a result, when undersampling, artificial bee colony was seen to perform better than other methods of optimization.

Özet

Sınıflama yöntemleri, sınıf gözlemlerinin sayısı farklı olduğunda çoğunluk sınıfını tahmin etme olasılığının yüksek olduğunu düşünür. Bu sorunu gidermek için literatürde yeniden örnekleme yöntemleri gibi bazı yöntemler bulunmaktadır. Yeniden örnekleme yöntemlerinden biri olan azörnekleme, çoğunluk sınıfından verileri silerek denge oluşturur. Bu çalışma, az örnekleme yapılırken çoğunluk sınıftan alınacak en uygun gözlemleri belirlemek için farklı optimizasyon yöntemlerini karşılaştırmayı amaçlamaktadır. İlk olarak, basit bir simülasyon çalışması yapılmış ve yeniden örneklenen veri setleri arasındaki farklılığı analiz etmek için grafikler kullanılmıştır. Daha sonra, farklı dengesiz veri setleri için farklı sınıflayıcı modelleri oluşturulmuştur. Bu modellerde rastgele azörnekleme, genetik algoritma ile azörnekleme, diferansiyel evrim algoritması ile azörnekleme, yapay arı kolonisi ile azörnekleme ve parçacık sürüsü optimizasyonu ile azörnekleme karşılaştırılmıştır. Sonuçlara sınıflandırıcılara ve veri setlerine göre değişen sıra numaraları verilmiş ve genel bir ortalama sıra elde edilmiştir. Sonuç olarak, yetersiz örnekleme yapıldığında, yapay arı kolonisinin diğer optimizasyon yöntemlerinden daha iyi performans gösterdiği görülmüştür.

🔖

Cite This Article

CENGİZ, M. A., SAĞLAM, F., SÖZEN, M. (2022). Optimization Based Undersampling for Imbalanced Classes. Adıyaman Üniversitesi Fen Bilimleri Dergisi, Cilt: 11 - Sayı: 2, 385–409. https://ajindex.com/articles/428415

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (14)

  1. Chen, L., Bao, L., Li, J., Cai, S., Cai, C., Chen, Z., An aliasing artifacts reducing approach with random undersampling for spatiotemporally encoded single-shot MRI, Journal of Magnetic Resonance, 237, 115-124, 2013
  2. Liu, B., Tsoumakas, G., Dealing with class imbalance in classifier chains via random undersampling, Knowledge-Based Systems, 192:105292, 2019
  3. Tomek, I., Two modifications of CNN, IEEE Transactions on Systems, Man, and Cybernetics, SMC-6 (11), 769-772, 1976
  4. Elhassan, T., Aljourf, M., Al-Mohanna, F., Shoukri, M., Classification of imbalance data using tomek link (t-link) combined with random under-sampling (rus) as a data reduction method, Global Journal of Technology and Optimization, S1, 2017
  5. Pereira, R.M., Costa, Y.M., Silla Jr, C.N., MLTL: A multi-label approach for the Tomek Link undersampling algorithm, Neurocomputing, 383, 95-105, 2020
  6. Devi, D., Purkayastha, B., Redundancy-driven modified Tomek-link based undersampling: A solution to class imbalance, Pattern Recognition Letters, 93, 3-12, 2017
  7. Wilson, D. L., Asymptotic properties of nearest neighbor rules using edited data, IEEE Transactions on Systems, Man, and Cybernetics, 3, 408-421, 1972.
  8. Laurikkala, J., Improving identification of difficult small classes by balancing class distribution, In Conference on Artificial Intelligence in Medicine in Europe (pp. 63-66), Springer, Berlin, Heidelberg, 2001.
  9. Bach, M., Werner, A., Palt, M., The Proposal of Undersampling Method for Learning from Imbalanced Datasets, Procedia Computer Science, 159, 125-134, 2019
  10. Lu, W., Li, Z., Chu, J., Adaptive ensemble undersampling-boost: a novel learning framework for imbalanced data, Journal of Systems and Software, 132, 272-282, 2017
  11. Lin, W.C., Tsai, C.F., Hu, Y.H., Jhang, J.S., Clustering-based undersampling in class-imbalanced data, Information Sciences, 409, 17-26, 2017
  12. Ofek, N., Rokach, L., Stern, R., Shabtai, A., Fast-CBUS: A fast clustering-based undersampling method for addressing the class imbalance problem, Neurocomputing, 243, 88-102, 2017
  13. Körzdörfer, G., Pfeuffer, J., Kluge, T., Gebhardt, M., Hensel, B., Meyer, C.H., Nittka, M., Effect of spiral undersampling patterns on FISP MRF parameter maps, Magnetic Resonance Imaging, 2019
  14. Holland, J.H., Adaptation in natural and artificial systems: an introductory analysis with applications to biology, con