Journals / Süleyman Demirel Üniversitesi Fen Bilimleri Enstitüsü Dergisi / 2023 / Cilt: 27 - Sayı: 1

Mask Fitting on Face Images Based on Morphing and Masked Face Recognition

Yüz Görüntülerine Morflemeye Dayalı Maske Giydirme ve Maskeli Yüz Tanıma

Pages
12–21
Publication Date
2023-04-25
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

In the experiments using CASIA-WebFace and LFW (Labeled Faces in the Wild) datasets, masked face recognition performance was achieved over 96.5%.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Viruses such as Covid-19 cause serious respiratory diseases, making the use of face masks important.
📊
Key Findings & Data:For this reason, it is expected that face recognition and verification systems can also work with masked faces.
💡
Conclusion & Impact:In the experiments using CASIA-WebFace and LFW (Labeled Faces in the Wild) datasets, masked face recognition performance was achieved over 96.5%.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Maskeli yüz tanıma · Biyometrik kimlik tanıma · Otomatik maske giydirme

Abstract

Viruses such as Covid-19 cause serious respiratory diseases, making the use of face masks important. For this reason, it is expected that face recognition and verification systems can also work with masked faces. There are no masked faces in the data sets created for face recognition systems, and today, masks of different models and patterns can be used in daily life. These reduce the success of face recognition systems. In this study, first, a wide masked face data set was produced by fitting different types of masks to the images in the existing face datasets. In the production of masked faces close to nature, the automatic mask fitting process was carried out with the image morphing technique. Then, a deep learning based model was developed for the recognition of masked/unmasked faces, and the dataset created with the automatic mask fitting technique was used to train the model. In the experiments using CASIA-WebFace and LFW (Labeled Faces in the Wild) datasets, masked face recognition performance was achieved over 96.5%.

Özet

Covid-19 gibi virüslerin ciddi solunum yolu hastalıklarına neden olması, yüz maskelerinin kullanımını önemli hale getirmiştir. Bu nedenle yüzden kişi doğrulama ve tanıma yapan sistemlerin maskeli yüzler üzerinde de çalışabilmesi beklenmektedir. Yüz tanıma sistemleri için oluşturulan veri setlerinde maskeli yüzler olmamakla birlikte günümüzde farklı model ve desenlerde maskeler kullanılabilmektedir. Bunlar yüz tanıma sistemlerinin başarısını düşürmektedir. Bu çalışmada öncelikle maskeli yüz veri seti üretmek için mevcut yüz veri setlerine farklı tipteki maskelerin giydirilmesine çalışılmıştır. Morfleme tekniği kullanılarak yüzün pozisyonlarına uygun olarak doğala yakın otomatik giydirme işlemi gerçekleştirilmiştir. Daha sonra maskeli/maskesiz yüzlerin tanınması için derin öğrenmeye dayalı bir model geliştirilmiş ve otomatik maske giydirme tekniği ile oluşturulan veri seti denenmiştir. CASIA-WebFace ve LFW (Labeled Faces in the Wild) veri setleri kullanılarak gerçekleştirilen deneylerde %96.5’in üzerinde maskeli yüz tanıma başarımı elde edilmiştir.

🔖

Cite This Article

YILMAZ, A. G., GEDİKLİ, E., ALHORİ, O. (2023). Mask Fitting on Face Images Based on Morphing and Masked Face Recognition. Süleyman Demirel Üniversitesi Fen Bilimleri Enstitüsü Dergisi, Cilt: 27 - Sayı: 1, 12–21. https://ajindex.com/articles/888564

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (14)

  1. Dlib C++ Kütüphanesi, 2021. http://dlib.net/ (Erişim Tarihi: 15.12.2021)
  2. Yüz Hizalama Detektörü GTX kütüphanesi, 2015. https://github.com/davisking/dlib-models (Erişim Tarihi: 22.09.2021)
  3. Schroff, F., Kalenichenko, D., Philbin, J. 2015. Facenet: A Unified Embedding for Face Recognition and Clustering. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 7-12 June, Boston, MA, USA, 815-823
  4. Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A. A. 2017. Inception-v4, Inception-Resnet and The Impact of Residual Connections on Learning. Thirty-first AAAI Conference on Artificial Intelligence (AAAI17), 4-9 February, San Francisco, California USA, 4278-4284. 2017
  5. Zhang, K., Zhang, Z., Li, Z., Qiao, Y. 2016. Joint face Detection and Alignment Using Multitask Cascaded Convolutional Networks. IEEE Signal Processing Letters, 23(10), 1499 – 1503
  6. Qi, C., Yang, L. 2020. Face Recognition in The Scene of Wearing A Mask. 2020 International Conference on Advance in Ambient Computing and Intelligence (ICAACI). 12-13 September, Ottawa, ON, Canada, 77-80
  7. Alrikabi, J.M., Alibraheemi, K. H. 2021. A Combination Approach for Masked Face Recognition Based on Deep Learning. AM, 9(3), 499–520
  8. Wang, Z., Wang, G., Huang, B., Xiong, Z., Hong, Q., Wu, H., Yi, P., Jiang, K., Wang, N., Pei, Y., Chen, H., Miao,Y., Huang, Z., Liang, J. 2020. Masked Face Recognition Dataset and Application. arXiv preprint arXiv:2003.09093
  9. Mazli Shahar M.S., Mazalan, L. 2021. Face Identity for Face Mask Recognition System. 2021 IEEE 11th IEEE Symposium on Computer Applications &Industrial Electronics (ISCAIE). 3-4 April, Penang, Malaysia, 42-47
  10. Hariri, W. 2021. Efficient Masked Face Recognition Method during the COVID-19 Pandemic. arXiv preprint arXiv:2105.03026
  11. Vu, H.N., Nguyen, M.H., Pham, C. 2021. Masked face recognition with convolutional neural networks and local binary patterns. Applied Intelligence, Springer, Online
  12. Ejaz, M.S., Islam, M. R. 2019. Masked Face Recognition Using Convolutional Neural Network. 2019 International Conference on Sustainable Technologies for Industry 4.0 (STI), 24-25 December, Dhaka, Bangladesh, 1-6
  13. Jeevan, G., Zacharias, G.C., Nair, M.S., Rajan, J. 2022. An Empirical Study of The Impact of Masks on Face Recognition. Pattern Recognition, Volume 122(2022) 108308
  14. Luo, X., He, X., Qing, L., Chen, X., Liu, L., Xu, Y. 2020. EyesGAN: Synthesize Human Face from Human Eyes. Neurocomputing, 404(2020