A Comparative Analysis of Wavelet-Based FEMG Signal Denoising with Threshold Functions and Facial Expression Classification Using SVM and LSSVM

Document Type : Original Article

Authors

Department of Electrical Engineering, VJTI Mumbai, India

Abstract

This work presents a technique for the analysis of facial electromyogram signal activities to classify five different facial expressions for computer-muscle interfacing applications. Facial electromyogram (FEMG) is a technique for recording the asynchronous activation of neuronal inside the face muscles with non-invasive electrodes. FEMG pattern recognition is a difficult task for the researcher, where classification accuracy is key concerns. Artifacts, such as eyeblink activity and electroencephalogram (EEG) signals interference, can corrupt these FEMG signals and directly affected the classification results. In this work, a robust wavelet-based thresholding technique, which comprised of a wavelet transform (WT) method and the statistical threshold, is proposed to remove the different artifacts from FEMG datasets and improve recognition accuracy rate. A set of five different raw FEMG data set was analyzed. Four wavelet basis functions, namely, haar, coif3, sym3, and bior4.4, were considered. The performance parameters (signal-to-artifact ratio (SAR) and normalized mean square error (NMSE) were utilized to understand the effect of the proposed signal denoising protocol. After denoising, the effectiveness of different statically features has been extracted. Two pattern recognition algorithms support vector machine (SVM) and the least square support vector machine (LSSVM) are implemented to classify extracted features. The performance accuracy of SVM and LSSVM classifier was evaluated and compared to know which classifier is the best for facial expression classification.  The results showed that: (i) the proposed technique for denoising, improves the performance parameter results; (ii) The proposed work gives the best 95.24% classification accuracy.

Keywords

References

1. Kotzé, P., Eloff, M.M. and Adesina-Ojo, A., "Accessible computer interaction for people with disabilities: The case of quadriplegics, 6th International Conference on Enterprise Information Systems, Porto., (2004). http://hdl.handle.net/10500/465
2. Ferreira, A., Silva, R., Celeste, W., Bastos Filho, T. and Sarcinelli Filho, M., "Human–machine interface based on muscular and brain signals applied to a robotic wheelchair", in Journal of Physics: Conference Series, IOP Publishing. Vol. 90, (2007), 012094. DOI:10.1088/1742-6596/90/1/012094
3. Englehart, K., Hudgin, B. and Parker, P.A., "A wavelet-based continuous classification scheme for multifunction myoelectric control", IEEE Transactions on Biomedical Engineering, Vol. 48, No. 3, (2001), 302-311. DOI: 10.1109/10.914793
4. Englehart, K. and Hudgins, B., "A robust, real-time control scheme for multifunction myoelectric control", IEEE Transactions on Biomedical Engineering, Vol. 50, No. 7, (2003), 848-854. DOI: 10.1109/TBME.2003.813539
5. Kehri, V., Ingle, R., Patil, S. and Awale, R., Analysis of facial emg signal for emotion recognition using wavelet packet transform and svm, in Machine intelligence and signal analysis. 2019, Springer.247-257. DOI: https://doi.org/10.1007/978-981-13-0923-6_21
6. Shenoy, P., Miller, K.J., Crawford, B. and Rao, R.P., "Online electromyographic control of a robotic prosthesis", IEEE Transactions on Biomedical Engineering, Vol. 55, No. 3, (2008), 1128-1135. DOI: 10.1109/TBME.2007.909536
V. Kehri and R. N. Awale / IJE TRANSACTIONS A: Basics Vol. 33, No. 7, (July 2020) 1249-1256 1255
7. Tsui, C.S.L., Jia, P., Gan, J.Q., Hu, H. and Yuan, K., "Emg-based hands-free wheelchair control with eog attention shift detection", in 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO), IEEE. (2007), 1266-1271. DOI: 10.1109/ROBIO.2007.4522346
8. Firoozabadi, S.M.P., Oskoei, M.A. and Hu, H., "A human-computer interface based on forehead multi-channel bio-signals to control a virtual wheelchair", in Proceedings of the 14th Iranian conference on biomedical engineering (ICBME). (2008), 272-277.
9. Arjunan, S. and Kumar, D.K., "Recognition of facial movements and hand gestures using surface electromyogram (semg) for hci based applications", in 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007), IEEE. (2007), 1-6. DOI: 10.1109/DICTA.2007.4426768
10. Gibert, G., Pruzinec, M., Schultz, T. and Stevens, C., "Enhancement of human computer interaction with facial electromyographic sensors", in Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7. (2009), 421-424. DOI: https://doi.org/10.1145/1738826.1738914
11. Wei, L., Hu, H. and Yuan, K., "Use of forehead bio-signals for controlling an intelligent wheelchair", in 2008 IEEE International Conference on Robotics and Biomimetics, IEEE. (2009), 108-113. DOI: 10.1109/ROBIO.2009.4912988
12. Van den Broek, E., Lisy, V., Janssen, J., Westerink, J., Schut, M. and Tuinenbreijer, K., "Affective man-computer interface: Unveiling human emotions through biosignals", Biomedical Engineering Systems and Technologies, Vol. 52, (2010), 21-47. https://doi.org/10.1007/978-3-642-11721-3_2
13. Wei, L. and Hu, H., "Emg and visual based hmi for hands-free control of an intelligent wheelchair", in 2010 8th World Congress on Intelligent Control and Automation, IEEE. (2010), 1027-1032. DOI: 10.1109/WCICA.2010.5554766
14. Yang, G. and Yang, S., "Emotion recognition of electromyography based on support vector machine", in 2010 Third International Symposium on Intelligent Information Technology and Security Informatics, IEEE. (2010), 298-301. DOI: 10.1109/IITSI.2010.122
15. Hamedi, M., Rezazadeh, I.M. and Firoozabadi, M., "Facial gesture recognition using two-channel bio-sensors configuration and fuzzy classifier: A pilot study", in International Conference on Electrical, Control and Computer Engineering 2011 (InECCE), IEEE. (2011), 338-343. DOI: 10.1109/INECCE.2011.5953903
16. Hamedi, M., Salleh, S.-H. and Swee, T.T., "Surface electromyography-based facial expression recognition in bi-polar configuration", Journal of Computer Science, Vol. 7, No. 9, (2011), 1407-1415. ISSN 1549-3636
17. Hamedi, M., Salleh, S.-H., Tan, T., Ismail, K., Ali, J., Dee-Uam, C., Pavaganun, C. and Yupapin, P., "Human facial neural activities and gesture recognition for machine-interfacing applications", International Journal of Nanomedicine, Vol. 6, (2011), 3461-3472. DOI: 10.2147/IJN.S26619
18. Wei, L., Hu, H. and Zhang, Y., "Fusing emg and visual data for hands-free control of an intelligent wheelchair", International Journal of Humanoid Robotics, Vol. 8, No. 04, (2011), 707-724. DOI: 10.1142/S0219843611002629
19. Yang, Y.G. and Yang, S., "Study of emotion recognition based on surface electromyography and improved least squares support vector machine", Journal of Computers, Vol. 6, No. 8, (2011), 1707-1714. DOI:10.4304/jcp.6.8.1707-1714
20. Hamedi, M., Salleh, S.-H., Noor, A.M., Swee, T.T. and Afizam, I., "Comparison of different time-domain feature extraction methods on facial gestures' emgs", Progress In Electromagnetics Research, Vol. 1897, (2012), 1897-1900. DOI: http://eprints.utm.my/id/eprint/34373/
21. Hamedi, M., Salleh, S.-H., Noor, A., Harris, A.R. and Majid, N., "Multiclass least-square support vector machine for myoelectric-based facial gesture recognition", in The 15th International Conference on Biomedical Engineering, Springer. (2014), 180-183. DOI: 10.1007/978-3-319-02913-9_46
22. Gruebler, A. and Suzuki, K., "Design of a wearable device for reading positive expressions from facial emg signals", IEEE Transactions on Affective Computing, Vol. 5, No. 3, (2014), 227-237. DOI: 10.1109/TAFFC.2014.2313557
23. Chen, Y., Yang, Z. and Wang, J., "Eyebrow emotional expression recognition using surface emg signals", Neurocomputing, Vol. 168, (2015), 871-879. https://doi.org/10.1016/j.neucom.2015.05.037
24. Zikov, T., Bibian, S., Dumont, G.A., Huzmezan, M. and Ries, C., "A wavelet based de-noising technique for ocular artifact correction of the electroencephalogram", in Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society][Engineering in Medicine and Biology, IEEE. Vol. 1, (2002), 98-105. DOI: 10.1109/IEMBS.2002.1134407
25. M SadeghpourHaji; S. A. Mirbagheri; A. H. Javid; M. Khezri; G. D. Najafpour, "A wavelet support vector machine combination model for daily suspended sediment forecasting", International Journal of Engineering C: Aspects, Vol. 27, No. 6, (2014), 855-864. DOI:10.5829/idosi.ije.2014.27.06c.04
26. Kumar, P.S., Arumuganathan, R., Sivakumar, K. and Vimal, C., "Removal of ocular artifacts in the eeg through wavelet transform without using an eog reference channel", International Journal of Open Problems inComputer Science and Mathematics, Vol. 1, No. 3, (2008), 188-200. https://www.emis.de/journals/IJOPCM/files/IJOPCM(vol.1.3.2.D.8).pdf
27. Krishnaveni, V., Jayaraman, S., Malmurugan, N., Kandasamy, A. and Ramadoss, D., "Non adaptive thresholding methods for correcting ocular artifacts in eeg", Academic Open Internet Journal, Vol. 13, (2004). http://www.acadjournal.com/2004/V13/Part1/p2/
28. Cichocki, A., Shishkin, S.L., Musha, T., Leonowicz, Z., Asada, T. and Kurachi, T., "Eeg filtering based on blind source separation (bss) for early detection of alzheimer's disease", Clinical Neurophysiology, Vol. 116, No. 3, (2005), 729-737. https://doi.org/10.1016/j.clinph.2004.09.017
29. Soomro, M.H., Badruddin, N., Yusoff, M.Z. and Malik, A.S., "A method for automatic removal of eye blink artifacts from eeg based on emd-ica", in 2013 IEEE 9th International Colloquium on Signal Processing and its Applications, IEEE. (2013), 129-134. DOI: 10.1109/CSPA.2013.6530028
30. Kehri, V. and Awale, R., "Emg signal analysis for diagnosis of muscular dystrophy using wavelet transform, svm and ann", Biomedical and Pharmacology Journal, Vol. 11, No. 3, (2018), 1583-1591. DOI: https://dx.doi.org/10.13005/bpj/1525
31. Shen, J. and Zhou, X., "Least squares support vector machine for constitutive modeling of clay", International Journal of Engineering, Vol. 28, No. 11, (2015), 1571-1578. DOI: 10.5829/idosi.ije.2015.28.11b.04
32. Suykens, J., Lukas, L., Van Dooren, P., De Moor, B. and Vandewalle, J., "Least squares support vector machine classifiers: A large scale algorithm", in Proceedings of the European Conference on Circuit Theory and Design, Citeseer. Vol. 10, (1999). https://perso.uclouvain.be/paul.vandooren/publications/SuykensLVDV99.pdf
33. Toledo-Pérez, D.C., Rodríguez-Reséndiz, J., Gómez-Loenzo, R.A. and Jauregui-Correa, J., "Support vector machine-based
1256 V. Kehri and R. N. Awale / IJE TRANSACTIONS A: Basics Vol. 33, No. 7, (July 2020) 1249-1256
emg signal classification techniques: A review", Applied Sciences, Vol. 9, No. 20, (2019), 4402. https://doi.org/10.3390/app9204402
34. Toledo-Pérez, D.C., Martínez-Prado, M.A., Gómez-Loenzo, R.A., Paredes-García, W.J. and Rodríguez-Reséndiz, J., "A study of movement classification of the lower limb based on up to 4-emg channels", Electronics, Vol. 8, No. 3, (2019), 259. https://doi.org/10.3390/electronics8030259
35. Toledo-Pérez, D., Rodríguez-Reséndiz, J. and Gómez-Loenzo, R.A., "A study of computing zero crossing methods and an improved proposal for emg signals", IEEE Access, Vol. 8, (2020), 8783-8790. DOI: 10.1109/ACCESS.2020.2964678
36. Purushothaman, G. and Vikas, R., "Identification of a feature selection based pattern recognition scheme for finger movement recognition from multichannel emg signals", Australasian Physical & Engineering Sciences in Medicine, Vol. 41, No. 2, (2018), 549-559. DOI: 10.1007/s13246-018-0646-7
37. Too, J., Abdullah, A., Saad, N.M., Ali, N. And Zawawi, T.T., "Application of spectrogram and discrete wavelet transform for emg pattern recognition", Journal of Theoretical & Applied Information Technology, Vol. 96, No. 10, (2018), 3036-3047. http://www.jatit.org/volumes/Vol96No10/24Vol96No10.pdf
38. Sui, X., Wan, K. and Zhang, Y., "Pattern recognition of semg based on wavelet packet transform and improved svm", Optik, Vol. 176, (2019), 228-235. https://doi.org/10.1016/j.ijleo.2018.09.040
International Journal of Engineering
Volume 33, Issue 7
TRANSACTIONS A: Basics
July 2020
Pages 1249-1256

Files

Share

How to cite

Statistics