Feature Extraction from Several Angular Faces Using a Deep Learning Based Fusion Technique for Face Recognition

Document Type : Original Article

Authors

Faculty of Computer Engineering, Shahrood University of Technology, Shahrood, Iran

Abstract

Due to its non-interfering nature, face recognition has been the most suitable technology for designing biometric systems in recent years.  This technology is used in various industries, such as health care, education, security, and surveillance. Facial recognition technology works best when a person is looking straight into the camera. On the contrary, the performance of facial recognition degrades when encountered with an angled facial image, because they are generally trained using images of a full face. The purpose of this paper is to estimate the feature vector of a full face image when there are several angular facial images of the same person, one example being angular faces in a video. This method extracts the basic features of a facial image using the non-negative matrix factorization (NMF) method. Then, the feature vectors are fused using a generative adversarial network (GAN) to estimate the feature vector associated with the frontal image. The experimental results on the angular images of the FERET dataset show that the proposed method can significantly improve the accuracy of facial  recognition technology methods.

Keywords

Main Subjects

References

  1. Kortli, Y., Jridi, M., Al Falou, A. and Atri, M., "Face recognition systems: A survey", Sensors, Vol. 20, No. 2, (2020), 342.  doi: 10.3390/s20020342.
  2. Annalakshmi, M., Roomi, S.M.M. and Naveedh, A.S., "A hybrid technique for gender classification with slbp and hog features", Cluster Computing, Vol. 22, (2019), 11-20. doi: 10.1007/s10586-017-1585-x.
  3. Dinesh, P. S. and Manikandan, Dr.M., "Face Reconstruction using Eigenface and Neural Network", Tierärztliche Praxis, Vol. 40, (2020), 1940-1968.
  4. Aliyu, I., Ali Bom, M. and Maishanu, M., "A Comparative Study of Eigenface and Fisherface Algorithms Based on OpenCV and Sci-kit Libraries Implementations", International Journal of Information Engineering and Electronic Busin, Vol. 3, (2022), 30-40. doi: 10.5815/ijieeb.2022.03.0.
  5. Maghari, A.Y.A., "Recognition of partially occluded faces using regularized ICA", Inverse Problems in Science and Engineering, Vol. 29, No. 8, (2021), 1158-1177. doi: 10.1080/17415977.2020.1845329.
  6. Rakshit, R.D. and Kisku, D.R., "Face Identification via Strategic Combination of Local Features", Computational Intelligence in Pattern Recognition, Vol. 999, (2020), 207-217.
  7. Hassanpour, H. and Ghasemi, M., "A three-stage filtering approach for face recognition", International Journal of Engineering, Transactions B: Applications, Vol. 34, No. 8, (2021), 1856-1864. doi: 10.5829/ije.2021.34.08b.06.
  8. Shavandi, M. and Afrakoti, I., "Face recognition in thermal images based on sparse classifier", International Journal of Engineering, Transactions A: Basics, Vol. 32, No. 1, (2019), 78-84. doi: 10.5829/ije.2019.32.01a.10.
  9. Abed, R., Bahroun, S., Zagrouba, E., "KeyFrame extraction based on face quality measurement and convolutional neural network for efficient face recognition in videos ", Multimedia Tools and Applications, Vol. 80, (2021), 23157-23179. doi: 10.1007/s11042-020-09385-5.
  10. Zhang, J., Yan, X., Cheng, Z. and Shen, X., "A face recognition algorithm based on feature fusion", Concurrency and Computation: Practice and Experience, Vol. 34, No. 14, (2022), e5748. doi: 10.1002/cpe.5748.
  11. Shanthi, P., Nickolas, S., "An efficient automatic facial expression recognition using local neighborhood feature fusion ", Multimedia Tools and Applications, Vol. 80, (2021), 10187–10212. doi: 10.1007/s11042-020-10105-2.
  12. Ksieniewicz, P., Zyblewski, P., Burduk, R., " Fusion of linear base classifiers in geometric space ", Knowledge-Based Systems, Vol. 227, No. 3, (2021). doi: 10.1016/j.knosys.2021.107231.
  13. Singh, M., Singh, R. and Ross, A., "A comprehensive overview of biometric fusion", Information Fusion, Vol. 52, No., (2019), 187-205. doi: 10.1016/j.inffus.2018.12.003
  14. AL-Shatnawi, A., Al-Saqqar, F., El-Bashir, M. and Nusir, M., "Face recognition model based on the laplacian pyramid fusion technique", International Journal of Advances in Soft Computing & Its Applications, Vol. 13, No. 1, (2021).
  15. Štruc, V., Gros, J.Z., Dobrišek, S. and Pavešic, N., "Exploiting representation plurality for robust and efficient face recognition", in Proceedings of the 22nd Intenational Electrotechnical and Computer Science Conference (ERK’13), Citeseer, (2013), 121-124.
  16. Hu, J., Lu, J. and Tan, Y.-P., "Discriminative deep metric learning for face verification in the wild", in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2014), 1875-1882.
  17. Jabid, T., Kabir, M.H. and Chae, O., "Local directional pattern (ldp) for face recognition", in 2010 digest of technical papers international conference on consumer electronics (ICCE), IEEE, (2010), 329-330. doi: 10.1109/ICCE.2010.5418801.
  18. Al-Dabagh, M.Z.N., Ahmad, M.I., Isa, M.N.M. and Anwar, S.A., "Face recognition system based on fusion features of local methods using cca", in 2020 8th International Electrical Engineering Congress (iEECON), IEEE, (2020), 1-4. doi: 10.1109/iEECON48109.2020.229489.
  19. Liu, Z. and Liu, C., "Fusion of color, local spatial and global frequency information for face recognition", Pattern Recognition, Vol. 43, No. 8, (2010), 2882-2890. doi: 10.1016/j.patcog.2010.03.003.
  20. Uzair, M., Mahmood, A. and Mian, A., "Hyperspectral face recognition with spatiospectral information fusion and pls regression", IEEE Transactions on Image Processing, Vol. 24, No. 3, (2015), 1127-1137. doi: 10.1109/TIP.2015.2393057.
  21. Bi, Y., Lv, M., Wei, Y., Guan, N. and Yi, W., "Multi-feature fusion for thermal face recognition", Infrared Physics & Technology, Vol. 77, (2016), 366-374. doi: 10.1016/j.infrared.2016.05.011.
  22. Zhu, Y. and Jiang, Y., "Optimization of face recognition algorithm based on deep learning multi feature fusion driven by big data", Image and Vision Computing, Vol. 104, (2020), 104023. doi: 10.1016/j.imavis.2020.104023.
  23. Wang, Y., Shi, D. and Zhou, W., "Convolutional neural network approach based on multimodal biometric system with fusion of face and finger vein features", Sensors, Vol. 22, No. 16, (2022), 6039. doi: 10.3390/s22166039.
  24. Medjahed, C., Rahmoun, A., Charrier, C. and Mezzoudj, F., "A deep learning-based multimodal biometric system using score fusion", IAES International Journal of Artificial Intelligence, Vol. 11, No. 1, (2022), 65. doi: 10.11591/ijai.v11.i1.
  25. Xu, H., Qi, M. and Lu, Y., "Multimodal biometrics based on convolutional neural network by two-layer fusion", in 2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), IEEE, (2019), 1-6. doi: 10.1109/CISP-BMEI48845.2019.8966036.
  26. Almabdy, S. and Elrefaei, L., "Feature extraction and fusion for face recognition systems using pre-trained convolutional neural networks", International Journal of Computing and Digital Systems, Vol. 9, No., (2021), 1-7. doi: 10.12785/ijcds/100144.
  27. Khosravi, M.H., Hassanpour, H. and Ahmadifard, A., "A content recognizability measure for image quality assessment considering the high frequency attenuating distortions", Multimedia Tools and Applications, Vol. 77, (2018), 7357-7382. doi: 10.1007/s11042-017-4636-7.
  28. Aonishi, T., Maruyama, R., Ito, T., Miyakawa, H., Murayam, M., Ota, K.," Imaging data analysis using non-negative matrix factorization ", Neuroscience Research,  Vol. 179, (2022), 51-56. doi: 10.1016/j.neures.2021.12.001.
  29. Liu, H., Zheng, X., Han, J., Chu, Y. and Tao, T., "Survey on gan‐based face hallucination with its model development", IET Image Processing, Vol. 13, No. 14, (2019), 2662-2672. doi: 10.1049/iet-ipr.2018.6545.
  30. Rong, C., Zhang, X. and Lin, Y., "Feature-improving generative adversarial network for face frontalization", IEEE Access,  Vol. 8, (2020), 68842-68851. doi: 10.1109/ACCESS.2020.2986079.
  31. Shahbakhsh, M.B. and Hassanpour, H., "Empowering face recognition methods using a gan-based single image super-resolution network", International Journal of Engineering, Vol. 35, No. 10, (2022), 1858-1866. doi: 10.5829/IJE.2022.35.10A.05.
  32. Han, Z. and Huang, H., "Gan based three-stage-training algorithm for multi-view facial expression recognition", Neural Processing Letters, Vol. 53, (2021), 4189-4205. doi: 10.1007/s11063-021-10591-x.
  33. Phillips, P.J., Wechsler, H., Huang, J. and Rauss, P.J., "The feret database and evaluation procedure for face-recognition algorithms", Image and Vision Computing, Vol. 16, No. 5, (1998), 295-306. doi: 10.1007/s11063-021-10591-x.
  34. Nikan, F. and Hassanpour, H., "Face recognition using non-negative matrix factorization with a single sample per person in a large database", Multimedia Tools and Applications, Vol. 79, No. 37-38, (2020), 28265-28276. doi: 10.1007/s11042-020-09394-4.
International Journal of Engineering
Volume 36, Issue 8
TRANSACTIONS B: Applications
August 2023
Pages 1548-1555

Files

Cited by

Share

How to cite

Statistics