Fuzzy Centralized Coordinate Learning and Hybrid Loss for Human Activity Recognition

Document Type : Original Article

Authors

Department of Computer Engineering, Babol Branch, Islamic Azad University, Babol, Iran

Abstract

Human activity recognition has been a popular research topic in recent years. The rapid development of deep learning techniques has greatly helped researchers to achieve success in this field. But the researches in the literature, usually ignore the distribution of features in the coordinate space despite its great effect on the convergence status of network and activities classification. This paper proposes a hybrid method based on fuzzy centralized coordinate learning and a hybrid loss function to overcome the explained constraint. The fuzzy centralized coordinate learning induces features to be dispersedly spanned across all quadrants of the coordinate space. This causes the angle between the feature vectors of the activity classes to increase significantly. Furthermore, a hybrid loss function is suggested to increase the discriminative power of the proposed method. Our experiments were carried out on the OPPORTUNITY and the PAMAP2 datasets. The proposed model has been compared with six machine learning and three deep learning methods for activity recognition. Experimental results showed that the proposed method outperformed all of the comparative methods due to the identification of discriminative features. The proposed method successfully enhanced the average accuracy by 14.99% and 2.94% on the PAMAP2 and OPPORTUNITY datasets, respectively, compared to the deep learning methods.

Keywords

References

  1.  

    1. Li, Frédéric, Kimiaki Shirahama, Muhammad Adeel Nisar, Lukas Köping, and Marcin Grzegorzek. "Comparison of feature learning methods for human activity recognition using wearable sensors." Sensors 18, No. 2, (2018), 679, DOI: 10.3390/s18020679 .
    2. Ogbuabor, Godwin, and Robert La. "Human activity recognition for healthcare using smartphones." Proceedings of the 2018 10th International Conference on Machine Learning and Computing. (2018), https://doi.org/10.1145/3195106.3195157.
    3. Khan, Adil Mehmood, Y-K. Lee, Seok-Yong Lee, and T-S. Kim. "Human activity recognition via an accelerometer-enabled-smartphone using kernel discriminant analysis." In 2010 5th international conference on future information technology, IEEE, (2010), 1-6. DOI: 10.1109/FUTURETECH.2010.5482729.
    4. Shoaib, Muhammad, Stephan Bosch, Ozlem Durmaz Incel, Hans Scholten, and Paul JM Havinga. "A survey of online activity recognition using mobile phones." Sensors 15, No. 1, (2015), 2059-2085, https://doi.org/10.3390/s150102059.
    5. Mobark, Mohammed, Suriayati Chuprat, and Teddy Mantoro. "Improving the accuracy of complex activities recognition using accelerometer-embedded mobile phone classifiers." In 2017 Second International Conference on Informatics and Computing (ICIC), IEEE, (2017), 1-5. DOI: 10.1109/IAC.2017.8280606.
    6. Chen, Zhenghua, Qingchang Zhu, Yeng Chai Soh, and Le Zhang. "Robust human activity recognition using smartphone sensors via CT-PCA and online SVM." IEEE Transactions on Industrial Informatics 13, No. 6, (2017), 3070-3080, DOI: 10.1109/TII.2017.2712746.
    7. Uddin, Md Taufeeq, Md Muttlaleb Billah, and Md Faisal Hossain. "Random forests based recognition of human activities and postural transitions on smartphone." In 2016 5th International Conference on Informatics, Electronics and Vision (ICIEV), pp. 250-255. IEEE, (2016), DOI: 10.1109/ICIEV.2016.7760005.
    8. Fan, Liwei, Kim-Leng Poh, and Peng Zhou. "A sequential feature extraction approach for naïve bayes classification of microarray data." Expert Systems with Applications 36, No. 6, (2009), 9919-9923.
    9. Bustoni, I. A., I. Hidayatulloh, A. M. Ningtyas, A. Purwaningsih, and S. N. Azhari. "Classification methods performance on human activity recognition." In Journal of Physics: Conference Series, vol. 1456, No. 1, p. 012027. IOP Publishing, (2020).
    10. Georgiou, Theodoros, Yu Liu, Wei Chen, and Michael Lew. "A survey of traditional and deep learning-based feature descriptors for high dimensional data in computer vision." International Journal of Multimedia Information Retrieval 9, No. 3, (2020), 135-170.
    11. Dargan, Shaveta, Munish Kumar, Maruthi Rohit Ayyagari, and Gulshan Kumar. "A survey of deep learning and its applications: a new paradigm to machine learning." Archives of Computational Methods in Engineering 27, No. 4, (2020), 1071-1092.
    12. Feizi, A. "Convolutional gating network for object tracking." International Journal of Engineering, Transactions A: Basics 32, No. 7, (2019), 931-939, DOI: 10.5829/ije.2019.32.07a.05.
    13. Hassanpour, M., and H. Malek. "Learning Document Image Features With SqueezeNet Convolutional Neural Network." International Journal of Engineering 33, No. 7, (2020), 1201-1207, DOI: 10.5829/ije.2020.33.07a.05.
    14. Chikhaoui, Belkacem, and Frank Gouineau. "Towards automatic feature extraction for activity recognition from wearable sensors: a deep learning approach." In 2017 IEEE International Conference on Data Mining Workshops (ICDMW), 693-702. IEEE, (2017), DOI: 10.1109/ICDMW.2017.97.
    15. Panwar, Madhuri, S. Ram Dyuthi, K. Chandra Prakash, Dwaipayan Biswas, Amit Acharyya, Koushik Maharatna, Arvind Gautam, and Ganesh R. Naik. "CNN based approach for activity recognition using a wrist-worn accelerometer." In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2438-2441. IEEE, (2017), DOI: 10.1109/EMBC.2017.8037349.
    16. Cruciani, Federico, Anastasios Vafeiadis, Chris Nugent, Ian Cleland, Paul McCullagh, Konstantinos Votis, Dimitrios Giakoumis, Dimitrios Tzovaras, Liming Chen, and Raouf Hamzaoui. "Feature learning for human activity recognition using convolutional neural networks." CCF Transactions on Pervasive Computing and Interaction 2, No. 1, (2020), 18-32.
    17. Ordóñez, Francisco Javier, and Daniel Roggen. "Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition." Sensors 16, No. 1, (2016), 115, https://doi.org/10.3390/s16010115.
    18. Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Softmax units for multinoulli output distributions. Deep Learning." (2018), 180-184.
    19. Sun, Jian, Yongling Fu, Shengguang Li, Jie He, Cheng Xu, and Lin Tan. "Sequential human activity recognition based on deep convolutional network and extreme learning machine using wearable sensors." Journal of Sensors, (2018), https://doi.org/10.1155/2018/8580959.
    20. Huang, Guang-Bin, Hongming Zhou, Xiaojian Ding, and Rui Zhang. "Extreme learning machine for regression and multiclass classification." IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 42, No. 2, (2011), 513-529, DOI: 10.1109/TSMCB.2011.2168604.
    21. Liu, Weiyang, Yandong Wen, Zhiding Yu, and Meng Yang. "Large-margin softmax loss for convolutional neural networks." In International Conference on Machine Learning, vol. 2, No. 3, p. 7. (2016).
    22. Liu, Weiyang, Yandong Wen, Zhiding Yu, Ming Li, Bhiksha Raj, and Le Song. "Sphereface: Deep hypersphere embedding for face recognition." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 212-220. (2017).
    23. Qi, Xianbiao, and Lei Zhang. "Face recognition via centralized coordinate learning." arXiv preprint arXiv:1801.05678 (2018).
    24. Huang, Gary B., Marwan Mattar, Tamara Berg, and Eric Learned-Miller. "Labeled faces in the wild: A database forstudying face recognition in unconstrained environments." In Workshop on faces in'Real-Life'Images: detection, alignment, and recognition. (2008).
    25. Chen, Bor-Chun, Chu-Song Chen, and Winston H. Hsu. "Cross-age reference coding for age-invariant face recognition and retrieval." In European conference on computer vision, pp. 768-783. Springer, Cham, (2014).
    26. Deng, Weihong, Jiani Hu, Nanhai Zhang, Binghui Chen, and Jun Guo. "Fine-grained face verification: FGLFW database, baselines, and human-DCMN partnership." Pattern Recognition 66 (2017), 63-73, https://doi.org/10.1016/j.patcog.2016.11.023.
    27. Zheng, Tianyue, Weihong Deng, and Jiani Hu. "Cross-age lfw: A database for studying cross-age face recognition in unconstrained environments." arXiv preprint arXiv:1708.08197 (2017).
    28. Wolf, Lior, Tal Hassner, and Itay Maoz. "Face recognition in unconstrained videos with matched background similarity." In in Computer Vision and Pattern Recognition (CVPR) 2011, pp. 529-534. IEEE, (2011), DOI: 10.1109/CVPR.2011.5995566
    29. Kemelmacher-Shlizerman, Ira, Steven M. Seitz, Daniel Miller, and Evan Brossard. "The megaface benchmark: 1 million faces for recognition at scale." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4873-4882. (2016).
    30. Lara, Oscar D., and Miguel A. Labrador. "A survey on human activity recognition using wearable sensors." IEEE Communications Surveys & Tutorials 15, No. 3, (2012), 1192-1209, DOI: 10.1109/SURV.2012.110112.00192.
    31. Lin J, Keogh E, Lonardi S, Chiu B. "A symbolic representation of time series, with implications for streaming algorithms". InProceedings of the 8th ACM SIGMOD workshop on Research issues in data mining and knowledge discovery 2003; 2-11, https://doi.org/10.1145/882082.882086.
    32. Cook, Diane J., and Narayanan C. Krishnan. "Activity learning: discovering, recognizing, and predicting human behavior from sensor data". John Wiley & Sons, (2015).
    33. Lawal, Isah A., and Sophia Bano. "Deep human activity recognition with localisation of wearable sensors." IEEE Access 8, (2020), 155060-155070, DOI: 10.1109ACCESS.2020.3017681.
    34. Zohrevand, A., Imani, Z. and Ezoji, M.. "Deep Convolutional Neural Network for Finger-knuckle-print Recognition". International Journal of Engineering, Transactions A: Basics, 2021, Vol. 34, No. 7, 1684-1693, DOI: 10.5829/ije.2021.34.07a.12.
    35. Gers, Felix A., Nicol N. Schraudolph, and Jürgen Schmidhuber. "Learning precise timing with LSTM recurrent networks." Journal of Machine Learning Research 3, (2002), 115-143.
    36. Chavarriaga, Ricardo, Hesam Sagha, Alberto Calatroni, Sundara Tejaswi Digumarti, Gerhard Tröster, José del R. Millán, and Daniel Roggen. "The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition." Pattern Recognition Letters 34, No. 15, (2013), 2033-2042, https://doi.org/10.1016/j.patrec.2012.12.014.
    37. Reiss, Attila, and Didier Stricker. "Introducing a new benchmarked dataset for activity monitoring." In 2012 16th international symposium on wearable computers, IEEE, (2012), 108-109. DOI: 10.1109/ISWC.2012.13.
    38. Zeiler, Matthew D. "Adadelta: an adaptive learning rate method." arXiv preprint arXiv:1212.5701 (2012).
    39. Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E. Hinton. "Imagenet classification with deep convolutional neural networks." Advances in neural information processing systems 25 (2012), 1097-1105.
International Journal of Engineering
Volume 35, Issue 1
TRANSACTIONS A: Basics
January 2022
Pages 130-141

Files

Cited by

Share

How to cite

Statistics