Traffic Scene Analysis and Classification using Deep Learning

Document Type : Original Article


Department of Electrical Engineering, Payame Noor University (PNU), Tehran, Iran


In this study, we aim to use new deep-learning tools and convolutional neural networks for traffic analysis. ResNeXt architecture, one of the most potent architectures and has attracted much attention in various fields, has been proposed to examine the scene, and classify it into three categories: cars, bikes (bicycles/motorcycles), and pedestrians. Previous studies have focused more on one type of classification and reported only human-facial recognition or vehicle detection. In contrast, the proposed method uses precise architecture to perform the classification of three classes. The proposed plan has been implemented in several steps: the first stage is to divide the critical objects. In the next step, the characteristics of the obtained objects are extracted to classify the process into three classes. Experiments have been conducted on different and essential datasets such as high-traffic, low-quality, real-time scenes. Essential evaluation criteria such as accuracy, sensitivity, and specificity show that the performance of the proposed method has improved compared to the methods being compared. The accuracy criterion reached more than 92%, sensitivity about 89%, and specially to 90.25%. The proposed method can be used to implement intelligent cities, public safety, and metropolitan decisions and use the results in urban management, predictive modeling of lost data management, sequential data management, and generalizability.

Graphical Abstract

Traffic Scene Analysis and Classification using Deep Learning


Main Subjects

  1. Al-Mallahi A, Natarajan M, Shirzadifar A. Development of robust communication algorithm between machine vision and boom sprayer for spot application via ISO 11783. Smart Agricultural Technology. 2023;4:100212.
  2. Dorrani Z. Road Detection with Deep Learning in Satellite Images. Majlesi Journal of Telecommunication Devices. 2023;12(1):43-7.
  3. Long F, Yao T, Qiu Z, Li L, Mei T, editors. PointClustering: Unsupervised Point Cloud Pre-Training Using Transformation Invariance in Clustering. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2023.
  4. Ranjith CP, Hardas BM, Mohideen MSK, Raj NN, Robert NR, Mohan P. Robust deep learning empowered real time object detection for unmanned aerial vehicles based surveillance applications. Journal of Mobile Multimedia. 2023:451–76-–76.
  5. Torkaman A, Badie K, Salajegheh A, Bokaei M, Fatemi Ardestani S. A Hybrid Approach to Detect Researchers’ Communities Based on Deep Learning and Game Theory. International Journal of Engineering, Transactions B: Applications. 2023;36(11):2052-62. 10.5829/IJE.2023.36.11B.10
  6. Aslinezhad M, Sezavar A, Malekijavan A. A noise-aware deep learning model for automatic modulation recognition in radar signals. International Journal of Engineering, Transactions B: Applications. 2023;36(8):1459-67. 10.5829/IJE.2023.36.08B.06
  7. Medjdoubi A, Meddeber M, Yahyaoui K. Smart City Surveillance: Edge Technology Face Recognition Robot Deep Learning Based. International Journal of Engineering, Transactions A: Basics. 2024;37(1):25-36. 10.5829/IJE.2024.37.01A.03
  8. Rohani M, Farsi H, Mohamadzadeh S. Deep Multi-task Convolutional Neural Networks for Efficient Classification of Face Attributes. International Journal of Engineering, Transaction B: Applications. 2023;36(11):2102-11. 10.5829/IJE.2023.36.11B.14
  9. Kurdthongmee W, Suwannarat K, Kiplagat J. A Framework to Create a Deep Learning Detector from a Small Dataset: A Case of Parawood Pith Estimation. Emerging Science Journal. 2022;7(1):245-55. 10.28991/ESJ-2023-07-01-017
  10. Kurdthongmee W, Suwannarat K, Wattanapanich C. A Framework to Estimate the Key Point Within an Object Based on a Deep Learning Object Detection. HighTech and Innovation Journal. 2023;4(1):106-21. 10.28991/HIJ-2023-04-01-08
  11. Zhang H, Liptrott M, Bessis N, Cheng J, editors. Real-time traffic analysis using deep learning techniques and UAV based video. 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS); 2019: IEEE. 10.1109/AVSS.2019.8909879
  12. Sharma T, Debaque B, Duclos N, Chehri A, Kinder B, Fortier P. Deep learning-based object detection and scene perception under bad weather conditions. Electronics. 2022;11(4):563. 10.3390/ELECTRONICS11040563
  13. Dorrani Z, Farsi H, Mohammadzadeh S. Edge Detection and Identification using Deep Learning to Identify Vehicles. Journal of Information Systems and Telecommunication (JIST). 2022;3(39):201. 10.52547/JIST.16385.10.39.201
  14. Cengiz E, Yilmaz C, KAHRAMAN H. Classification of human and vehicles with the deep learning based on transfer learning method. Düzce Üniversitesi Bilim ve Teknoloji Dergisi. 2021;9(3):215-25. 10.29130/DUBITED.842394
  15. Dheekonda RSR, Panda SK, Khan N, Al-Hasan M, Anwar S. Object detection from a vehicle using deep learning network and future integration with multi-sensor fusion algorithm. 2017.
  16. Thanathamathee P, Sawangarreerak S, Kongkla P, Nizam DNM. An Optimized Machine Learning and Deep Learning Framework for Facial and Masked Facial Recognition. Emerging Science Journal. 2023;7(4):1173-87. 10.28991/ESJ-2023-07-04-010
  17. Fooladi S, Farsi H, Mohamadzadeh S. Segmenting the lesion area of brain tumor using convolutional neural networks and fuzzy k-means clustering. International Journal of Engineering, Transaction B: Applications. 2023;36(8):1556-68. 10.5829/IJE.2023.36.08B.15
  18. Lu S, Ding Y, Liu M, Yin Z, Yin L, Zheng W. Multiscale feature extraction and fusion of image and text in VQA. International Journal of Computational Intelligence Systems. 2023;16(1):54. 10.1007/S44196-023-00233-6
  19. Dorrani Z, Farsi H, Mohamadzadeh S. Deep Learning in Vehicle Detection Using ResUNet-a Architecture. Jordan Journal of Electrical Engineering. 2022;8(2):166-78. 10.5455/JJEE.204-1638861465
  20. Dorrani Z, Farsi H, Mohamadzadeh S. Image edge detection with fuzzy ant colony optimization algorithm. International Journal of Engineering, Transactions C: Aspects 2020;33(12):2464-70. 10.5829/IJE.2020.33.12C.05
  21. Wang Y, Ban X, Wang H, Wu D, Wang H, Yang S, et al. Detection and classification of moving vehicle from video using multiple spatio-temporal features. IEEE Access. 2019;7:80287-99. 10.1109/ACCESS.2019.2923199