Enhanced Face Presentation Attack Prevention Employing Feature Fusion of Pre-trained Deep Convolutional Neural Network Model and Thepade's Sorted Block Truncation Coding

Document Type : Original Article

Authors

Computer Engineering Department, Pimpri Chinchwad College of Engineering, Pune, India

Abstract

The evolution and improvements of deep learning are being used to tackle any research obstacles that could be converted into classification problems in all spheres of life. Each Deep convolutional neural network (DCNN) design's output is determined by the depth and value of the hyperparameters, which explains why so many of them have been proposed. These DCNN architectures must be created entirely from scratch, and they can only be used for the applications for which they were intended. Transfer learning may be used to modify these pre-trained networks so they are more appropriate for particular purposes. This article aims to evaluate the empirical performance of the applicability of pre-trained DCNN models to identify human face presentation threats (FPAD). Human FPAD is one of the most significant and crucial areas of research right now because of the introduction of ambient computing, which necessitates contact-free identification of persons with the help of their biometric traits. Six pre-trained DCNN models are taken into account for an experimental evaluation in human FPAD alias VGG19, VGG16, DensNet121, MobileNet, Xception,  and InceptionV3. The investigation makes use of the NUAA and Replay-Attack benchmark FPAD datasets. Thepade's sorted block truncation coding (SBTC) 10-ary features are merged with deep learning features produced from the finest performing finetuned DCNNs to enhance the FPAD capabilities of analyzed machine learning (ML) classifiers. The integration of features of Thepade's SBTC 10-ary and DCNN has considerably increased the FPAD accuracy of ML classifiers with slightly more computations of feature extraction.

Keywords

Main Subjects

References

  1. Kekre, H., Thepade, S.D. and Maloo, A., "Face recognition using texture features extracted from walshlet pyramid", ACEEE International Journal on Recent Trends in Engineering and Technology (IJRTET), Vol. 5, No. 1, (2011), 186-190. https://doi.org/10.5120/1672-2256
  2. Kekre, H., Thepade, S.D. and Chopra, T., "Face and gender recognition using principal component analysis", International Journal on Computer Science and Engineering, Vol. 2, No. 4, (2010), 959-964.oi.
  3. Shahbakhsh, M.B. and Hassanpour, H., "Empowering face recognition methods using a gan-based single image super-resolution network", International Journal of Engineering, Transactions A: Basics, Vol. 35, No. 10, (2022), 1858-1866. https://www.ije.ir/article_150976.html
  4. Asghari Beirami, B. and Mokhtarzade, M., "Ensemble of log-euclidean kernel svm based on covariance descriptors of multiscale gabor features for face recognition", International Journal of Engineering, Transactions B: Applications, Vol. 35, No. 11, (2022), 2065-2071. https://www.ije.ir/article_153711.html
  5. Thepade, S.D. and Bidwai, P., "Iris recognition using fractional coefficients of transforms, wavelet transforms and hybrid wavelet transforms", in 2013 International Conference on Control, Computing, Communication and Materials (ICCCCM), IEEE., (2013), 1-5.
  6. Kekre, H., Thepade, S.D., Jain, J. and Agrawal, N., "Iris recognition using texture features extracted from walshlet pyramid", in Proceedings of the International Conference & Workshop on Emerging Trends in Technology., (2011), 76-81.
  7. Thepade, D.S. and Mandal, P.R., "Novel iris recognition technique using fractional energies of transformed iris images using haar and kekre transforms", International Journal of Scientific & Engineering Research, Vol. 5, No. 4, (2014), 305-308. https://www.ijser.org/researchpaper/Novel-Iris-Recognition-Technique-using-Fractional-Energies.pdf
  8. Khade, S. and Thepade, S.D., "Novel fingerprint liveness detection with fractional energy of cosine transformed fingerprint images and machine learning classifiers", in 2018 IEEE Punecon, IEEE., (2018), 1-7.
  9. Khade, S., Thepade, S.D. and Ambedkar, A., "Fingerprint liveness detection using directional ridge frequency with machine learning classifiers", in 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA), IEEE., (2018), 1-5.
  10. Kekre, H., Thepade, S.D. and Maloo, A., "Eigenvectors of covariance matrix using row mean and column mean sequences for face recognition", International Journal of Biometrics and Bioinformatics (IJBB), Vol. 4, No. 2, (2010), 42-50.
  11. Keramati Hatkeposhti, R., Yadollahzadeh Tabari, M. and GolsorkhtabariAmiri, M., "Fall detection using deep learning algorithms and analysis of wearable sensor data by presenting a new sampling method", International Journal of Engineering, Transactions A: Basics, Vol. 35, No. 10, (2022), 1941-1958. https://www.ije.ir/article_151530.html
  12. Fallah, A., Soleymani, A. and Khosravi, H., "A method for automatic lane detection using a deep network", International Journal of Engineering, Transactions A: Basics, Vol. 35, No. 4, (2022), 802-809. https://www.ije.ir/article_143621.html
  13. Azimi, B., Rashno, A. and Fadaei, S., "Fully convolutional networks for fluid segmentation in retina images", in 2020 International Conference on Machine Vision and Image Processing (MVIP), IEEE., (2020), 1-7.
  14. Thepade, S.D. and Chaudhari, P.R., "Land usage identification with fusion of thepade sbtc and sauvola thresholding features of aerial images using ensemble of machine learning algorithms", Applied Artificial Intelligence, Vol. 35, No. 2, (2021), 154-170. https://doi.org/10.1080/08839514.2020.1842627
  15. Thepade, S.D., Chaudhari, P.R. and Das, R., "Identifying land usage from aerial image using feature fusion of thepade’s sorted n-ary block truncation coding and bernsen thresholding with ensemble methods", International Journal of Engineering and Advanced Technology (IJEAT), Vol. 9, No. 3, (2020), 2612-2621. doi.
  16. Thepade, S.D., Subhedarpage, K.S. and Mali, A.A., "Performance rise in content based video retrieval using multi-level thepade's sorted ternary block truncation coding with intermediate block videos and even-odd videos", in 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI), IEEE., (2013), 962-966.
  17. Madane, M. and Thepade, S., "Score level fusion based bimodal biometric identification using thepade's sorted n-ary block truncation coding with variod proportions of iris and palmprint traits", Procedia Computer Science, Vol. 79, (2016), 466-473. doi: 10.1016/j.procs.2016.03.060.
  18. Thepade, S.D. and Patil, P.H., "Novel visual content summarization in videos using keyframe extraction with thepade's sorted ternary block truncation coding and assorted similarity measures", in 2015 International Conference on Communication, Information & Computing Technology (ICCICT), IEEE. (2015), 1-5.
  19. Lucena, O., Junior, A., Moia, V., Souza, R., Valle, E. and Lotufo, R., "Transfer learning using convolutional neural networks for face anti-spoofing", in Image Analysis and Recognition: 14th International Conference, ICIAR 2017, Montreal, QC, Canada, July 5–7, 2017, Proceedings 14, Springer., (2017), 27-34.
  20. Chen, F.M., Wen, C., Xie, K., Wen, F.Q., Sheng, G.Q. and Tang, X.G., "Face liveness detection: Fusing colour texture feature and deep feature", IET Biometrics, Vol. 8, No. 6, (2019), 369-377. https://doi.org/10.1049/iet-bmt.2018.5235
  21. Tang, Y., Wang, X., Jia, X. and Shen, L., "Fusing multiple deep features for face anti-spoofing", in Biometric Recognition: 13th Chinese Conference, CCBR 2018, Urumqi, China, August 11-12, 2018, Proceedings 13, Springer., (2018), 321-330.
  22. Tu, X. and Fang, Y., "Ultra-deep neural network for face anti-spoofing", in Neural Information Processing: 24th International Conference, ICONIP 2017, Guangzhou, China, November 14-18, 2017, Proceedings, Part II 24, Springer. (2017), 686-695.
  23. Das, P.K., Hu, B., Liu, C., Cui, K., Ranjan, P. and Xiong, G., "A new approach for face anti-spoofing using handcrafted and deep network features", in 2019 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI), IEEE., (2019), 33-38.
  24. Elloumi, W., Chetouani, A., Charrada, T.B. and Fourati, E., "Anti-spoofing in face recognition: Deep learning and image quality assessment-based approaches", Deep Biometrics, (2020), 51-69. https://doi.org/10.1007/978-3-030-32583-1_4
  25. Song, L. and Ma, H., "Face liveliness detection based on texture and color features", in 2019 IEEE 4th International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), IEEE., (2019), 418-422.
  26. Jagdale, P. and Thepade, S., "Face liveness detection using feature fusion using block truncation code technique", International Journal on Recent and Innovation Trends in Computing and Communication, Vol. 7, No. 8, (2019), 19-22. https://doi.org/10.17762/ijritcc.v7i8.5348
  27. Thepade, S., Jagdale, P., Bhingurde, A. and Erandole, S., "Novel face liveness detection using fusion of features and machine learning classifiers", in 2020 IEEE international conference on informatics, IoT, and enabling technologies (ICIoT), IEEE. (2020), 141-145.
  28. Thepade, S.D., Chaudhari, P., Dindorkar, M., Bang, S. and Bangar, R., "Improved face spoofing detection using random forest classifier with fusion of luminance chroma", International Journal of Computer Information Systems and Industrial Management Applications, Vol. 12, No. 2020, (2020), 374-386.
  29. Abdullakutty, F., Johnston, P. and Elyan, E., "Fusion methods for face presentation attack detection", Sensors, Vol. 22, No. 14, (2022), 5196.
  30. Muhammad, U., Yu, Z. and Komulainen, J., "Self-supervised 2d face presentation attack detection via temporal sequence sampling", Pattern Recognition Letters, Vol. 156, (2022), 15-22.
  31. Abdullakutty, F., Elyan, E., Johnston, P. and Ali-Gombe, A., "Deep transfer learning on the aggregated dataset for face presentation attack detection", Cognitive Computation, Vol. 14, No. 6, (2022), 2223-2233. https://doi.org/10.1007/s12559-022-10037-z
  32. Simonyan, K. and Zisserman, A., "Very deep convolutional networks for large-scale image recognition", arXiv preprint arXiv:1409.1556, (2014).
  33. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. and Wojna, Z., "Rethinking the inception architecture for computer vision", in Proceedings of the IEEE conference on computer vision and pattern recognition., (2016), 2818-2826.
  34. Huang, G., Liu, Z., Van Der Maaten, L. and Weinberger, K.Q., "Densely connected convolutional networks", in Proceedings of the IEEE conference on computer vision and pattern recognition., (2017), 4700-4708.
  35. Chollet, F., "Xception: Deep learning with depthwise separable convolutions", in Proceedings of the IEEE conference on computer vision and pattern recognition., (2017), 1251-1258.
  36. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M. and Adam, H., "Mobilenets: Efficient convolutional neural networks for mobile vision applications", arXiv preprint arXiv:1704.04861, (2017).
  37. Badre, S.R. and Thepade, S.D., "Novel video content summarization using thepade's sorted n-ary block truncation coding", Procedia Computer Science, Vol. 79, (2016), 474-482. https://doi.org/10.1016/j.procs.2016.03.061
  38. Chingovska, I., Anjos, A. and Marcel, S., "On the effectiveness of local binary patterns in face anti-spoofing", in 2012 BIOSIG-proceedings of the international conference of biometrics special interest group (BIOSIG), IEEE., (2012), 1-7.
  39. Tan, X., Li, Y., Liu, J. and Jiang, L., "Face liveness detection from a single image with sparse low rank bilinear discriminative model", ECCV (6), Vol. 6316, (2010), 504-517. https://doi.org/10.1007/978-3-642-15567-3_37
International Journal of Engineering
Volume 36, Issue 4
TRANSACTIONS A: Basics
April 2023
Pages 807-816

Files

Cited by

Share

How to cite

Statistics