Journals / Pamukkale Üniversitesi Mühendislik Bilimleri Dergisi / 2017 / Cilt: 23 - Sayı: 5

An accelerated approach for facial expression analysis on video files

Video dosyaları üzerinde yüz ifade analizi için hızlandırılmış bir yaklaşım

Pages
602–613
Publication Date
2017-10-20
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Additionally, the results of image frames which were found to be incorrect were fixed by performing error analysis on the results of statistical analysis.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Automatic analysis and classification of facial expressions is a challenging problem which takes the attention of researchers studying in many areas such as human-computer interaction, computer vision and image processing.
📊
Key Findings & Data:In this study, an approach is proposed for the accelerated facial expression analysis of video files.
💡
Conclusion & Impact:Additionally, the results of image frames which were found to be incorrect were fixed by performing error analysis on the results of statistical analysis.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Çok-Çekirdekli hızlandırma · Haar özellikleri · Kübik Bézier eğrileri

Abstract

Automatic analysis and classification of facial expressions is a challenging problem which takes the attention of researchers studying in many areas such as human-computer interaction, computer vision and image processing. Currently, especially due to developments in human-computer interaction, the understanding of human emotions by computer has become an indispensable issue. Besides, analysis and recognition of facial expressions has prevailed in various areas like psychology, security, health, entertainment, and robotics. For these reasons, the analyzing of facial expressions quickly and correctly play a critical role for many software systems in different applications. In this study, an approach is proposed for the accelerated facial expression analysis of video files. Facial expressions are considered in four class; happy, normal, confused and sad. By reducing the total number of analyzed video frames and using parallel threads, performance evaluation of the expression analysis accelerated on multi-core computer was presented. Experimental results were obtained using quad-core processor with Hyper Threading technology. According to experimental results, quad core processor using two threads produced about 1.8 fold speed-up and four threads produced about 3 fold speed-up while eight threads produced about 3.5 fold speed-up has been obtained. Additionally, the results of image frames which were found to be incorrect were fixed by performing error analysis on the results of statistical analysis.

Özet

Yüz ifadelerinin otomatik olarak analiz edilmesi ve sınıflandırılması; insan-bilgisayar etkileşimi, bilgisayarlı görme ve görüntü işleme gibi birçok alanda çalışılan zorlu bir problemdir. Son zamanlarda özellikle insan-bilgisayar etkileşiminde yaşanan gelişmelerle birlikte, insanlara ait duyguların bilgisayarlar tarafından anlaşılması elzem bir konu haline gelmiştir. Bunun yanında psikoloji, güvenlik, sağlık, oyun ve robotik gibi birçok çalışma alanında da yüz ifadelerinin analizine duyulan ihtiyaç giderek artmaktadır. Bu nedenlerden dolayı, yüz ifadelerinin hızlı ve doğru bir şekilde analiz edilmesi farklı uygulama alanlarında birçok yazılım sistemi için kritik bir rol oynamaktadır. Bu çalışmada, video dosyalarının hızlandırılmış yüz ifade analizi için bir yaklaşım önerilmiştir. Yüz ifadeleri mutluluk, normal, şaşkınlık ve üzüntü olmak üzere dört sınıfta ele alınmıştır. Analiz edilen toplam video kare sayısı azaltılarak ve paralel iş parçacıkları kullanılarak hızlandırılan ifade analizinin çok-çekirdekli bilgisayar üzerinde başarım değerlendirmesi sunulmuştur. Deneysel sonuçlar Hyper Threading teknolojisine sahip dört-çekirdekli işlemci kullanılarak elde edilmiştir. İşlemci üzerinde 2 iş parçacığı ile yaklaşık 1.8 kat, 4 iş parçacığı ile ise yaklaşık 2.9 kat hızlandırma elde edilirken; 8 iş parçacığı ile hızlandırma oranı yaklaşık olarak 3.5 kata çıkarılmıştır. Ayrıca istatiksel analiz sonuçları üzerinde hata analizi yapılarak, hatalı olduğu tespit edilen görüntü karelerine ait sonuçlar düzeltilmiştir.

🔖

Cite This Article

Bayrakdar, S., Akgün, D., Yücedağ, İ. (2017). An accelerated approach for facial expression analysis on video files. Pamukkale Üniversitesi Mühendislik Bilimleri Dergisi, Cilt: 23 - Sayı: 5, 602–613. https://ajindex.com/articles/42499

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (16)

  1. Mehriban A. “Communication without words”. Psychology Today, 2(4), 53-56, 1968.
  2. Suwa M, Sugie N, Fujimora K. “A preliminary note on pattern recognition of human emotional expression”. 4th International Joint Conference on Pattern Recognition, Kyoto, Japan, 7-10 November 1978.
  3. Murtaza M, Sharif M, Raza M, Shah JH. “Analysis of face recognition under varying facial expression: a survey”. The International Arab Journal of Information Technology, 10(4), 378-388, 2013.
  4. Yang MH, Kriegman DJ, Ahuja N. “Detecting faces in images: a survey”. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1), 34-58, 2002.
  5. Tian YL, Kanade T, Cohn JF. Facial Expression Analysis. Editors: Li SZ, Jain AK. Handbook of Face Recognition, East Lansing, Michigan, USA, Springer, 2005.
  6. Ekman P, Friesen WV. “Constants across cultures in the face and emotion”. Journal of Personality and Social Psychology, 17(2), 124-129, 1971.
  7. Ekman P. “Universals and cultural differences in facial expressions of emotion”. Nebraska Symposium on Motivation, Nebraska, USA, 1972.
  8. Akgun D. “A Practical parallel implementation for TDLMS image filter on multi-core processor”. Journal of Real-Time Image Processing, 13(2), 249-260, 2017.
  9. Ekman P, Friesen WV. Facial Action Coding System: A Technique for the Measurement of Facial Movement. California, USA, Consulting Psychology Press, 1978. Ekman P. Methods for Measuring Facial Action. Editors: Scherer K, Ekman P. Handbook of Methods in Nonverbal Behavior Research, 45-135,
  10. New York, USA, Cambridge University Press, 1982.
  11. Yacoob Y, Davis LS. “Recognizing human facial expressions from long image sequences using optical flow”. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(6), 636-642, 1996.
  12. Cohen I, Garg A, Huang TS. “Emotion recognition from facial expressions using multilevel HMM”. Neural Information Processing Systems, 2000.
  13. Lajevardi SM, Lech M. “Facial expression recognition from image sequences using optimized feature selection”. IEEE 23rd International Conference Image and Vision Computing (IVCNZ), Christchurch, New Zealand, 26-28 November 2008.
  14. Khan MI, Bhuiyan A. “Facial expression recognition for human-robot interface”. International Journal of Computer Science and Network Security, 9(4), 300-306, 2009.
  15. Özmen G, Kandemir R. “Haar dalgacıkları ve kübik bezier eğrileri ile yüz ifadesi tespiti”. Elektrik-Elektronik ve Bilgisayar Mühendisliği Sempozyumu, Bursa, Türkiye, 29 Kasım-01 Aralık 2012.
  16. Rai P, Dixit M. “Smile detection v