SavedAdd your journal

Journals / Pamukkale Üniversitesi Mühendislik Bilimleri Dergisi / 2022 / Cilt: 28 - Sayı: 5

A human-computer interaction system based on eye, eyebrow and head movements

Göz, kaş ve baş hareketlerine dayalı bir insan-bilgisayar etkileşimi sistemi

Muhammed Oğuz TAS
Hasan Serhan YAVUZ
Pages
632–642
Publication Date
2022-10-31
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

We obtained satisfactory results on the designed interface in the experimental study.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Devices like computers that require manual control are difficult to use by disabled people such as having multiple sclerosis (MS), amyotrophic lateral sclerosis (ALS), partial stroke, etc.
📊
Key Findings & Data:These people have a very limited movement capability such that they can do most of the interaction with a limited movement of head and the eye.
💡
Conclusion & Impact:We obtained satisfactory results on the designed interface in the experimental study.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:İnsan bilgisayar etkileşimi · Engelli insan · Yüz tanıma

Abstract

Devices like computers that require manual control are difficult to use by disabled people such as having multiple sclerosis (MS), amyotrophic lateral sclerosis (ALS), partial stroke, etc. These people have a very limited movement capability such that they can do most of the interaction with a limited movement of head and the eye. Assistive technologies are very important for people with disabilities not to be dependent on anyone in daily life. In this study, we present a humancomputer interaction application that works based on analysis of the head and eye/eyebrow movements from real-time images captured by a visual camera. We propose Difference Between Eye and Eyebrow (DEEB) features to detect the action intention of the user and properly realize the computer keyboard and mouse actions based on eyebrow, eye and head movements. In addition, there are shortcut keys in the designed interface that facilitate access to Instagram, WhatsApp, YouTube etc. which are considered to make it easier for individuals with disabilities to communicate with their social environment. We obtained satisfactory results on the designed interface in the experimental study.

Özet

Manuel kontrol gerektiren bilgisayar gibi cihazların, Multipl Skleroz (MS), Amiyotrofik Lateral Skleroz (ALS), kısmi felç gibi engelli kişiler tarafından kullanılması zordur. Bu kişiler sınırlı hareket kabiliyetine sahip olduklarından çevresiyle iletişimlerinin çoğunu kısıtlı baş ve göz hareketleri ile gerçekleştirebilmektedirler. Engellilerin günlük hayatta kimseye bağımlı olmaması için yardımcı teknolojiler oldukça önemlidir. Bu çalışmada, görsel kamera ile elde edilmiş gerçek zamanlı görüntülerden baş ve göz/kaş hareketlerinin analizine dayalı çalışan bir insan-bilgisayar etkileşimi uygulaması sunulmaktadır. Kullanıcının eylem niyetini tespit etmek ve kaş, göz ve baş hareketlerine göre bilgisayar klavyesi ve fare eylemlerini doğru bir şekilde gerçekleştirmek için Göz ve Kaş Arasındaki Fark (DEEB) özniteliği önerilmiştir. Ayrıca tasarlanan arayüzde, engelli bireylerin sosyal çevreleriyle iletişim kurmasını kolaylaştırdığı düşünülen Instagram, WhatsApp, YouTube vb. sosyal platformlara erişimlerini kolaylaştıran kısayol tuşları da bulunmaktadır. Deneysel çalışmada tasarlanan arayüzde tatmin edici sonuçlar elde edilmiştir

🔖

Cite This Article

TAS, M. O., YAVUZ, H. S. (2022). A human-computer interaction system based on eye, eyebrow and head movements. Pamukkale Üniversitesi Mühendislik Bilimleri Dergisi, Cilt: 28 - Sayı: 5, 632–642. https://ajindex.com/articles/696834

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (13)

  1. Rapp A, Cena F, Castaldo R, Keller R, Tirassa M. “Designing technology for spatial needs: Routines, control and social competences of people with autism.” International Journal of Human-Computer Studies, 120, 49-65, 2018
  2. Jacko JA. Human Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, 3rd ed. London, England, Taylor and Francis Inc, 2012
  3. Evans DG, Drew R, Blenkhorn P. “Controlling mouse pointer position using an infrared head-operated joystick”. IEEE Transactions on rehabilitation engineering, 8(1), 107-117, 2000
  4. Wook Kim Y, Hyun Cho J. “A novel development of headset type computer mouse using gyro sensors for the handicapped”. In 2nd Annual International IEEE-EMBS Special Topic Conference on Microtechnologies in Medicine and Biology, Madison, USA, 2-4 May 2002
  5. Nowosielski A. “3-steps keyboard: reduced interaction interface for touchless typing with head movements”. In International Conference on Computer Recognition Systems, Polanica Zdroj, Poland, 22-24 May 2017
  6. Chen YL. “Application of tilt sensors in human-computer mouse interface for people with disabilities”. IEEE Transactions on neural systems and rehabilitation engineering, 9(3), 289-294, 2001
  7. Alhamzawi, HA. “Control Mouse Cursor by Head Movement: Development and Implementation”. Applied Medical Informatics, 40(3-4), 39-44, 2018
  8. Jacob RJ. “What you look at is what you get: eye movement-based interaction techniques”. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Seattle, USA, April, 1990
  9. Hutchinson TE, White KP, Martin WN, Reichert KC, Frey LA. “Human-computer interaction using eye-gaze input”. IEEE Transactions on Systems, Man, and Cybernetics, 19(6), 1527-1534, 1989
  10. Nasor M, Rahman KM, Zubair MM, Ansari H, Mohamed F. “Eye-controlled mouse cursor for physically disabled individual”. In 2018 Advances in Science and Engineering Technology International Conferences (ASET), Abu Dhabi, United Arab Emirates, 6 February-5 April 2018
  11. Singh H, Singh J. “Real-time eye blink and wink detection for object selection in HCI systems”. Journal on Multimodal User Interfaces, 12(1), 55-65, 2018
  12. Hegde VN, Ullagaddimath RS, Kumuda S. “Low cost eye based human computer interface system (Eye controlled mouse)”. In 2016 IEEE Annual India Conference (INDICON), Bangalore, India, 16-18 December 2016
  13. Kocejko T, Bujnowski A, Wtorek J. “Eye-mouse for disabled”. Human-Computer System