Dergiler / Celal Bayar Üniversitesi Fen Bilimleri Dergisi / 2019 / Cilt: 15 - Sayı: 4

A Weighted Similarity Measure for k-Nearest Neighbors Algorithm

Sayfa
393–400
Yayın Tarihi
2022-10-12
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

For some datasets, this new algorithm giveshighly good results.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:One of the most important problems in machine learning, which has gained importance in recent years, isclassification.
📊
Temel Bulgular & Veri:However, there are several factors affecting the performance of kNNalgorithm.
💡
Sonuç & Katkı:For some datasets, this new algorithm giveshighly good results.
🔬Tür:Modelleme & Sayısal Simülasyon
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Alan Parametreleri

Abstract

One of the most important problems in machine learning, which has gained importance in recent years, isclassification. The k-nearest neighbors (kNN) algorithm is widely used in classification problem becauseit is a simple and effective method. However, there are several factors affecting the performance of kNNalgorithm. One of them is determining an appropriate proximity (distance or similarity) measure.Although the Euclidean distance is often used as a proximity measure in the application of the kNN,studies show that the use of different proximity measures can improve the performance of the kNN. In thisstudy, we propose the Weighted Similarity k-Nearest Neighbors algorithm (WS-kNN) which use aweighted similarity as proximity measure in the kNN algorithm. Firstly, it calculates the weight of eachattribute and similarity between the instances in the dataset. And then, it weights similarities by attributeweights and creates a weighted similarity matrix to use as proximity measure. The proposed algorithm iscompared with the classical kNN method based on the Euclidean distance. To verify the performance ofour algorithm, experiments are made on 10 different real-life datasets from the UCI (UC Irvine MachineLearning Repository) by classification accuracy. Experimental results show that the proposed WS-kNNalgorithm can achieve comparative classification accuracy. For some datasets, this new algorithm giveshighly good results.

🔖

Bu Makaleye Atıf Yap

Ünver, H. M., Karabulut, B., Arslan, G. (2022). A Weighted Similarity Measure for k-Nearest Neighbors Algorithm. Celal Bayar Üniversitesi Fen Bilimleri Dergisi, Cilt: 15 - Sayı: 4, 393–400. https://ajindex.com/articles/472054

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (14)

  1. Jordan, MI, Mitchell, TM. 2015. Machine learning: Trends, perspectives, and prospects. Science; 349(6245): 255-260
  2. Singh, A, Thakur, N, Sharma, A. A review of supervised machine learning algorithms. In 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), IEEE, March 2016, pp. 1310-1315
  3. Cekik, R, Telceken, S. 2018. A new classification method based on rough sets theory. Soft Computing; 22(6): 1881-1889
  4. Soofi, AA, Awan, A. 2017. Classification Techniques in Machine Learning: Applications and Issues. Journal of Basic and Applied Sciences; 13: 459-465
  5. Aggarwal, CC. 2014. Instance-Based Learning: A Survey. Data Classification: Algorithms and Applications, 157
  6. Angiulli, F, Narvaez, E. 2018. Pruning strategies for nearest neighbors competence preservation learners. Neurocomputing; 308: 8-20
  7. Prasath, VB, Alfeilat, HAA, Lasassmeh, O, Hassanat, A. 2017. Distance and Similarity Measures Effect on the Performance of K-Nearest Neighbors Classifier-A Review. arXiv preprint arXiv:1708.04321
  8. Lei, Y, Zuo, MJ. 2009. Gear crack level identification based on weighted K nearest neighbors classification algorithm. Mechanical Systems and Signal Processing; 23(5): 1535-1547
  9. Khateeb, N, Usman, M. Efficient Heart Disease Prediction System using K-Nearest Neighbors Classification Technique, In Proceedings of the International Conference on Big Data and Internet of Thing ACM, December 2017, pp. 21-26
  10. Li, Q, Li, W, Zhang, J, Xu, Z. 2018. An improved k-nearestneighbors method to diagnose breast cancer. Analyst; 143(12): 2807-2811
  11. Liu, Y, Wang, X, Yan, K. 2018. Hand gesture recognition based on concentric circular scan lines and weighted K-nearest neighbors algorithm. Multimedia Tools and Applications; 77(1): 209-223. 110.18466/cbayarfbe. 6189642. Kılınç, D. 2016. The Effect of Ensemble Learning Models on Turkish Text Classification. Celal Bayar Üniversitesi Fen Bilimleri Dergisi, 12(2)
  12. Rodrigues, ÉO. 2018. Combining Minkowski and Cheyshev: New distance proposal and survey of distance metrics using k-nearest neighbours classifier. Pattern Recognition Letters; 110: 66-71
  13. Mulak, P, Talhar, N. 2015. Analysis of Distance Measures Using K-Nearest Neighbors Algorithm on KDD Dataset. International Journal of Science and Research; 4(7): 2101-2104
  14. Hu, LY, Huang, MW, Ke, SW, Tsai, CF. 2016. The distance function effect on k-nearest neighbors classification for medical datasets. SpringerPlus; 5(1):