SavedAdd your journal

Journals / Journal of Scientific Reports-A / 2022 / Sayı: 049

FACIAL EXPRESSION RECOGNITION on PARTIAL FACE IMAGES USING DEEP TRANSFER LEARNING

İsmail ÖZTEL
Gozde YOLCU ÖZTEL
Veysel Harun ŞAHİN
Pages
118–129
Publication Date
2022-06-30
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The experiments show that automated facial expression recognition can be applied with high performance by looking at the region containing eyes and eyebrows

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Facial expression recognition has a crucial role in communication.
📊
Key Findings & Data:People's faces can have occlusions because of scarves, facial masks, etc. in cases such as cold weather conditions or Covid-19 pandemic conditions.
💡
Conclusion & Impact:The experiments show that automated facial expression recognition can be applied with high performance by looking at the region containing eyes and eyebrows
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Convolutional Neural Networks · Deep Learning · Facial Expression Recognition

Abstract

Facial expression recognition has a crucial role in communication. Computerized facial expression recognition systems have been developed for many purposes. People's faces can have occlusions because of scarves, facial masks, etc. in cases such as cold weather conditions or Covid-19 pandemic conditions. In this case, facial expression recognition can be challenging for automated systems. This study classifies facial images containing only the eyebrow and eye regions over six expressions with a deep learning-based approach. For this purpose, Radboud Face Database images have been used after cropping the area that includes eye and eyebrow regions. Some popular pre-trained networks have been trained and tested using the transfer learning approach. The Vgg19 pre-trained network achieved 91.33% accuracy over the six universal facial expressions. The experiments show that automated facial expression recognition can be applied with high performance by looking at the region containing eyes and eyebrows

🔖

Cite This Article

ÖZTEL, İ., ÖZTEL, G. Y., ŞAHİN, V. H. (2022). FACIAL EXPRESSION RECOGNITION on PARTIAL FACE IMAGES USING DEEP TRANSFER LEARNING. Journal of Scientific Reports-A, Sayı: 049, 118–129. https://ajindex.com/articles/778954

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (12)

  1. Mehrabian, A., (1968), Some referents and measures of nonverbal behavior, Behavior Research Methods & Instrumentation, 1, 203–207
  2. Lopes, A.T., de Aguiar E., De Souza A.F., and Oliveira-Santos T., (2016), Facial Expression Recognition with Convolutional Neural Networks: Coping with Few Data and the Training Sample Order, Pattern Recognition, 67, 610-628
  3. Zalewski, L. and Gong, S., (2005), 2D Statistical Models of Facial Expressions for Realistic 3D Avatar Animation, IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), 2, 217–222
  4. Yolcu, G., Oztel, I., Kazan, S., Oz, C., Palaniappan, K., Lever, T.E. and Bunyak, F., (2017), Deep learning-based facial expression recognition for monitoring neurological disorders, IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 1652–1657
  5. Bartlett, M.S., Littlewort, G., Fasel, I., Chenu, J., Kanda, T., Ishiguro, H., Movellan, J.R., (2003), Towards social robots: Automatic evaluation of human-robot interaction by face detection and expression classification, Advances in Neural Information Processing Systems, 16
  6. Zhang, Y. and Hua, C., (2015), Driver fatigue recognition based on facial expression analysis using local binary patterns, Optik - International Journal for Light and Electron Optics, 126(23), 4501–4505
  7. Shaykha, I., Menkara, A., Nahas, M. and Ghantous, M., (2015), FEER: Non-intrusive facial expression and emotional recognition for driver’s vigilance monitoring, 57th International Symposium ELMAR (ELMAR), 233–237
  8. Kim, J.-B., Hwang, Y., Bang, W.-C., Lee, H., Kim, J.D.K. and Kim, C.-Y., (2013), Real-time realistic 3D facial expression cloning for smart TV, IEEE International Conference on Consumer Electronics (ICCE), 240–241
  9. Niforatos, E. and Karapanos, E., (2015), EmoSnaps: a mobile application for emotion recall from facial expressions, Personal and Ubiquitous Computing, 19(2), 425–444
  10. Terzis, V., Moridis, C.N. and Economides, A.A., (2013), Measuring instant emotions based on facial expressions during computer-based assessment, Personal and Ubiquitous Computing, 17(1), 43–52
  11. Ekman P. and Friesen W.V., (1971), Constants across cultures in the face and emotion., Journal of Personality and Social Psychology, 17(2), 124–129
  12. Hsu, C.-T., Hsu S.-C. and Huang, C.-L., Facial expression recognition using Hough forest, (2013), 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference,