Journals / Gazi Üniversitesi Mühendislik Mimarlık Fakültesi Dergisi / 2023 / Cilt: 38 - Sayı: 3

A decision-making mechanism based on EMG signals and adaptive neural fuzzy inference system (ANFIS) for hand gesture prediction

El hareketi tahmini için EMG sinyalleri ve uyarlamalı sinirsel bulanık çıkarım sistemine (ANFIS) dayalı bir karar verme mekanizması

Pages
1417–1430
Publication Date
2023-01-06
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The proposed feature extraction method based on TF representation combined with FL techniques yielded encouraging results for the classification of nonstationary and nonlinear biological signals such as EMG.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Artificial intelligence (AI)-based technologies assist users in applying the intended action when upper extremity movement cannot be fully provided.
📊
Key Findings & Data:In this paper, a fuzzy logic (FL)-based decision-making mechanism is presented in order to provide effective control and improve the prediction performance of the stated systems.
💡
Conclusion & Impact:The proposed feature extraction method based on TF representation combined with FL techniques yielded encouraging results for the classification of nonstationary and nonlinear biological signals such as EMG.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Bulanık mantık · görgül kip ayrışımı · EMG

Abstract

Artificial intelligence (AI)-based technologies assist users in applying the intended action when upper extremity movement cannot be fully provided. Electromyography (EMG), a depiction of muscle activity, offers various advantages when employed with AI-based systems like virtual reality applications and prosthetics controls. In this paper, a fuzzy logic (FL)-based decision-making mechanism is presented in order to provide effective control and improve the prediction performance of the stated systems. In this regard, EMG signals were collected from 30 participants when imitating different seven hand gestures. After the necessary preprocessing and segmentation processes, the Empirical Mode Decomposition (EMD) method which is the first stage of the Hilbert-Huang Transform (HHT) was applied and Intrinsic Mode Functions (IMF) were obtained. High-resolution time-frequency (TF) images were obtained by applying HHT to the IMFs determined by a statistical selection method. Various distinctive features were extracted from the visualized TF images based on the joint representation of the time and frequency domain. The Adaptive Neuro-Fuzzy Inference System (ANFIS) was then fed these features, which used two alternative clustering approaches. For seven hand gesture classifications, the average accuracy scores for the Subtractive Clustering (SC) and Fuzzy C-mean (FCM) clustering methods were obtained as 93.88% and 92.10%, respectively. The proposed feature extraction method based on TF representation combined with FL techniques yielded encouraging results for the classification of nonstationary and nonlinear biological signals such as EMG.

Özet

Üst ekstremite hareketi tam olarak sağlanamadığında, yapay zeka (artificial intelligence/AI) sistemleri kullanıcılara amaçlanan hareketin uygulanması konusunda yardımcı olurlar. Kas aktivitesinin temsili olan elektromiyografi (EMG), sanal gerçeklik uygulamaları ve protez kontrolleri gibi AI-tabanlı sistemlerde kullanıldığında çeşitli faydalar sağlar. Bu çalışmada, bahsedilen sistemlere etkin kontrol sunmak ve tahmin performanslarını iyileştirmek amacıyla bulanık mantık (Fuzzy Logic/FL)-tabanlı bir karar verme mekanizması sunulmuştur. Bu bağlamda, 30 katılımcıdan yedi farklı el hareketini taklit etmesi sonucunda oluşan EMG sinyalleri toplandı. Gerekli ön işleme ve bölütleme işlemlerinin ardından elde edilen sinyallere Hilbert-Huang Dönüşümü'nün (HHD) ilk aşaması Görgül Kip Ayrışımı (GKA) metodu uygulandı ve İçsel Mod Fonksiyonları (İMF) elde edildi. İstatistiksel İMF seçim yöntemi ile belirlenen İMF’lere HHD uygulanmasıyla iyi çözünürlüklü zaman-frekans (time-frequency/TF) imgeleri elde edildi. Zaman ve frekans uzayının ortak temsiline dayalı görselleştirilmiş TF imgelerinden çeşitli ayırt edici öznitelikler çıkartıldı. İki farklı kümeleme tekniği uygulanan öznitelik veri seti, Uyarlamalı Sinirsel Bulanık Çıkarım Sistemi'ne (ANFIS) girdi olarak verildi. Yedi el hareketi sınıflandırması için Azaltımlı (Subtractive Clustering/SC) ve Bulanık C-ortalama (Fuzzy C-mean/FCM) kümeleme yöntemleri için ortalama doğruluk değerleri sırasıyla %93,88 ve %92,10 olarak elde edilmiştir. TF temsiline dayalı özniteliklerin FL yaklaşımlarıyla sınıflandırılması sonucu elde edilen bulgular, EMG gibi durağan ve doğrusal olmayan biyolojik sinyallerin sınıflandırılması için umut verici olduğunu göstermiştir.

🔖

Cite This Article

KISA, D. H., ÖZDEMİR, M. A., GÜREN, O., SOY, A. A. (2023). A decision-making mechanism based on EMG signals and adaptive neural fuzzy inference system (ANFIS) for hand gesture prediction. Gazi Üniversitesi Mühendislik Mimarlık Fakültesi Dergisi, Cilt: 38 - Sayı: 3, 1417–1430. https://ajindex.com/articles/875676

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (13)

  1. Balbinot A., Favieiro G., A Neuro-Fuzzy System for Characterization of Arm Movements, Sensors, 13 (2), 2613–2630, 2013.
  2. Fajardo J.M., Gomez O., Prieto F., EMG hand gesture classification using handcrafted and deep features, Biomed. Signal Process. Control, 63 (March 2020), 102210, 2021.
  3. Zahak M., Signal Acquisition Using Surface EMG and Circuit Design Considerations for Robotic Prosthesis, Computational Intelligence in Electromyography Analysis - A Perspective on Current Applications and Future Challenges, Naik G.R., IntechOpen, London, United Kingdom: IntechOpen, (2012).
  4. Kılıç E., Başer Ö., Kızılhan H., EMG-based stiffness estimation of ankle joint and real-time implementation on a variable stiffness ankle exoskeleton robot, J. Fac. Eng. Archit. Gazi Univ., 36 (1), 225–240, 2020.
  5. Ozdemir M.A., Kisa D.H., Guren O., Onan A., Akan A., EMG based Hand Gesture Recognition using Deep Learning, 2020 Med. Technol. Congr., 1–4, 2020.
  6. Arozi M., Ariyanto M., Kristianto A., Munadi, Setiawan J.D., EMG Signal Processing of Myo Armband Sensor for Prosthetic Hand Input using RMS and ANFIS, 2020 7th Int. Conf. Inf. Technol. Comput. Electr. Eng., 36–40, 2020. De la Cruz-Sánchez B.A., Arias-Montiel M., Lugo-González E., EMG-controlled hand exoskeleton for assisted bilateral rehabilitation, Biocybern. Biomed. Eng., 42 (2), 596–614, 2022.
  7. Kisa D.H., Ozdemir M.A., Guren O., Akan A., EMG based Hand Gesture Classification using Empirical Mode Decomposition Time-Series and Deep Learning, 2020 Med. Technol. Congr., 1–4, 2020.
  8. Ozdemir M.A., Kisa D.H., Guren O., Akan A., Hand gesture classification using time–frequency images and transfer learning based on CNN, Biomed. Signal Process. Control, 77 103787, 2022.
  9. Lee K.H., Min J.Y., Byun S., Electromyogram-Based Classification of Hand and Finger Gestures Using Artificial Neural Networks, Sensors, 22 (1), 225, 2021.
  10. Narayan Y., Hb vsEMG signal classification with time domain and Frequency domain features using LDA and ANN classifier, Mater. Today Proc., 37 (Part 2), 3226–3230, 2021.
  11. Zhai X., Jelfs B., Chan R.H.M., Tin C., Short latency hand movement classification based on surface EMG spectrogram with PCA, 2016 38th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 327–330, 2016.
  12. Phinyomark A., Phukpattaranont P., Limsakul C., Feature reduction and selection for EMG signal classification, Expert Syst. Appl., 39 (8), 7420–7431, 2012.
  13. Srhoj-Egekher V., Cifrek M., Medved V., The application of Hilbert-Huang transform in the analysis of muscle fat