A Multilayer Motion Direction Based Model for Tracking Vehicles at Intersections

Document Type : Original Article

Authors

1 Faculty of Computer Engineering, Shahrood University of Technology, Shahrood, Iran

2 Faculty of Electrical & Robotic Engineering, Shahrood University of Technology, Shahrood, Iran

Abstract

Visual vehicle tracking is an important topic in intelligent transportation systems. Intersections are challenging locations for visual systems to track vehicles which are simultaneously moving in different directions. In addition, normal traffic flow may change at intersections due to accidents. Congestion, occlusion and undetermined motion flows are the nominated challenging issues of vehicle tracking at intersections. In this paper, a method for tracking multiple vehicles is proposed considering the vehicle motion directions to overcome undetermined motion flows. For this purpose, a multilayer model is presented, which assigns each motion flows to distinct layers. Moreover, we introduce different neighborhoods for various layers considering the regular motion flows in a layer. Hence, vehicles entering from the same side of intersection with the same motion direction are assigned to the same layer. Then the tracking is performed on different layers separately. In special cases such as vehicles crossing each other, misdetections or occlusion, the proposed tracking method can predict the vehicles tracks by using the stored tracking history and considering neighborhoods in that layer. Experimental results show consistency between proposed tracking method results and ground truth, also outperformance of other tracking methods in tracking vehicles crossing the intersection.

Keywords

References

1.     Datondji, S. R. E., Dupuis, Y., Subirats, P., and Vasseur, P. “A Survey of Vision-Based Traffic Monitoring of Road Intersections.” IEEE Transactions on Intelligent Transportation Systems, Vol. 17, No. 10, (2016), 2681–2698. https://doi.org/10.1109/TITS.2016.2530146
2.     Shirazi, M. S., and Morris, B. T. “Looking at Intersections: A Survey of Intersection Monitoring, Behavior and Safety Analysis of Recent Studies.” IEEE Transactions on Intelligent Transportation Systems. Vol. 18, No. 1, (2017), 4-24. https://doi.org/10.1109/TITS.2016.2568920
3.     Gandhi, T., and Trivedi, M. M. “Pedestrian protection systems: Issues, survey, and challenges.” IEEE Transactions on Intelligent Transportation Systems, Vol. 8, No. 3, (2007), 413–430. https://doi.org/10.1109/TITS.2007.903444
4.     Buch, N., Velastin, S. A., and Orwell, J. “A review of computer vision techniques for the analysis of urban traffic.” IEEE Transactions on Intelligent Transportation Systems. Vol. 12, No. 3, (2011), 920-939 https://doi.org/10.1109/TITS.2011.2119372
5.     Sivaraman, S., and Trivedi, M. M. “Looking at vehicles on the road: A survey of vision-based vehicle detection, tracking, and behavior analysis.” IEEE Transactions on Intelligent Transportation Systems, Vol. 14, No. 4, (2013), 1773–1795. https://doi.org/10.1109/TITS.2013.2266661
6.     Hasanzadeh, R. P. R., Shahrouzi, S. N., and Mahdavi, M. “A Novel Method for Tracking Moving Objects using Block-Based Similarity.” International Journal of Engineering - Transactions B: Applications, Vol. 22, No. 1, (2009), 35–42. Retrieved from http://www.ije.ir/article_71756.html
7.     Sadegh Moghadasi, S., and Faraji, N. “An efficient target tracking algorithm based on particle filter and genetic algorithm.” International Journal of Engineering - Transactions A: Basics, Vol. 32, No. 7, (2019), 915–923. https://doi.org/10.5829/ije.2019.32.07a.03
8.     Jain, N. K., Saini, R. K., and Mittal, P. A review on traffic monitoring system techniques. Advances in Intelligent Systems and Computing, Vol. 742, (2019), 569-577. https://doi.org/10.1007/978-981-13-0589-4_53
9.     Kastrinaki, V., Zervakis, M., and Kalaitzakis, K. “A survey of video processing techniques for traffic applications.” Image and Vision Computing, Vol. 21, No. 4, (2003), 359–381. https://doi.org/10.1016/S0262-8856(03)00004-0
10.   Yilmaz, A., Javed, O., and Shah, M. “Object tracking: A survey.” ACM Computing Surveys. Vol. 38, No. 4, (2006). https://doi.org/10.1145/1177352.1177355
11.   Sun, Z., Bebis, G., and Miller, R. “On-road vehicle detection: A review.” IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 28, No. 5, (2006), 694-711. https://doi.org/10.1109/TPAMI.2006.104
12.   Messelodi, S., Modena, C. M., and Zanin, M. “A computer vision system for the detection and classification of vehicles at urban road intersections.” Pattern Analysis and Applications, Vol. 8, No. 1–2, (2005), 17–31. https://doi.org/10.1007/s10044-004-0239-9
13.   Song, X., and Nevatia, R. “Detection and tracking of moving vehicles in crowded scenes.” In 2007 IEEE Workshop on Motion and Video Computing, WMVC, (2007). https://doi.org/10.1109/WMVC.2007.13
14.   Veeraraghavan, H., Masoud, O., and Papanikolopoulos, N. P. “Computer vision algorithms for intersection monitoring.” IEEE Transactions on Intelligent Transportation Systems, Vol. 4, No. 2, (2003), 78–89. https://doi.org/10.1109/TITS.2003.821212
15.   Nateghinia, E., and Moradi, H. “Video-based multiple vehicle tracking at intersections.” In 2014 2nd RSI/ISM International Conference on Robotics and Mechatronics, ICRoM 2014, (2014), 215–220. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/ICRoM.2014.6990903
16.   Liu, L., Xi, Z., and Sun, Q. “Multi-vision tracking and collaboration based on spatial particle filter.” Journal of Visual Communication and Image Representation, Vol. 59, (2019), 316–326. https://doi.org/10.1016/j.jvcir.2018.12.050
17.   Shi, Y., and Real, F. D. “Smart cameras: Fundamentals and classification.” In Smart Cameras (pp. 19–34). Springer. https://doi.org/10.1007/978-1-4419-0953-4_2
18.   Liu, L., Xing, J., and Ai, H. “Multi-view vehicle detection and tracking in crossroads.” In 1st Asian Conference on Pattern Recognition, ACPR, (2011), 608–612. https://doi.org/10.1109/ACPR.2011.6166688
19.   Wang, W., Gee, T., Price, J., and Qi, H. “Real time multi-vehicle tracking and counting at intersections from a fisheye camera.” In Proceedings - 2015 IEEE Winter Conference on Applications of Computer Vision, WACV, (2015), 17–24. https://doi.org/10.1109/WACV.2015.10
20.   Lira, G., Kokkinogenis, Z., Rossetti, R. J. F., Moura, D. C., and Rúbio, T. “A computer-vision approach to traffic analysis over intersections.” In IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, (2016), 47–53. https://doi.org/10.1109/ITSC.2016.7795530
21.   Dey, B., and Kundu, M. K. “Turning video into traffic data - An application to urban intersection analysis using transfer learning.” IET Image Processing, Vol. 13, No. 4, (2019), 673–679. https://doi.org/10.1049/iet-ipr.2018.5985
22.   Subedi, S., and Tang, H. “Development of a multiple-camera 3D vehicle tracking system for traffic data collection at intersections.” IET Intelligent Transport Systems, Vol. 13, No. 4, (2019), 614–621. https://doi.org/10.1049/iet-its.2018.5163
23.   Li, C., Chiang, A., Dobler, G., Wang, Y., Xie, K., Ozbay, K., Ghandehari, M., Zhou, J., and Wang, D. “Robust vehicle tracking for urban traffic videos at intersections.” In 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS, (2016), 207–213. https://doi.org/10.1109/AVSS.2016.7738075
24.   Min, W., Fan, M., Guo, X., and Han, Q. “A New Approach to Track Multiple Vehicles with the Combination of Robust Detection and Two Classifiers.” IEEE Transactions on Intelligent Transportation Systems, Vol. 19, No. 1, (2018), 174–186. https://doi.org/10.1109/TITS.2017.2756989
25.   Bedruz, R. A., Sybingco, E., Bandala, A., Quiros, A. R., Uy, A. C., and Dadios, E. “Real-time vehicle detection and tracking using a mean-shift based blob analysis and tracking approach.” In HNICEM 2017 - 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (Vol. 2018), (2018), 1–5. https://doi.org/10.1109/HNICEM.2017.8269528
26.   Jodoin, J. P., Bilodeau, G. A., and Saunier, N. “Tracking All Road Users at Multimodal Urban Traffic Intersections.” IEEE Transactions on Intelligent Transportation Systems, Vol. 17, No. 11, (2016), 3241–3251. https://doi.org/10.1109/TITS.2016.2545245
27.   Strigel, E., Meissner, D., Seeliger, F., Wilking, B., and Dietmayer, K. “The Ko-PER intersection laserscanner and video dataset.” In 2014 17th IEEE International Conference on Intelligent Transportation Systems, ITSC, (2014), 1900–1901. https://doi.org/10.1109/ITSC.2014.6957976
28.   Meissner, D., Reuter, S., Strigel, E., and Dietmayer, K. “Intersection-based road user tracking using a classifying multiple-model PHD filter.” IEEE Intelligent Transportation Systems Magazine, Vol. 6, No. 2, (2014), 21–33. https://doi.org/10.1109/MITS.2014.2304754
29.   Yang, Y., and Bilodeau, G. “Multiple Object Tracking with Kernelized Correlation Filters in Urban Mixed Traffic.” In 2017 14th Conference on Computer and Robot Vision (CRV), (2017), 209–216. https://doi.org/10.1109/CRV.2017.18
30.   Ooi, H.-L., Bilodeau, G.-A., Saunier, N., and Beaupré, D.-A. “Multiple Object Tracking in Urban Traffic Scenes with a Multiclass Object Detector.” In Advances in Visual Computing (pp. 727–736). Cham: Springer International Publishing.
31.   Ooi, H.-L., Bilodeau, G.-A., and Saunier, N. “Tracking in Urban Traffic Scenes from Background Subtraction and Object Detection.” In Image Analysis and Recognition (pp. 195–206). Springer International Publishing.
32.   Chan, Z. Y., and Suandi, S. A. “City Tracker: Multiple Object Tracking in Urban Mixed Traffic Scenes.” In Proceedings of the 2019 IEEE International Conference on Signal and Image Processing Applications, ICSIPA, (2019), 335–339. https://doi.org/10.1109/ICSIPA45851.2019.8977783
33.   Delavarian, M., and Maarouzi, O. “Vehicle tracking at intersection in image sequences with multilayer concept.” In 2017 3rd Iranian Conference on Intelligent Systems and Signal Processing (ICSPIS), (2017), 131–135. https://doi.org/10.1109/ICSPIS.2017.8311603
34.   Ciaparrone, G., Luque Sánchez, F., Tabik, S., Troiano, L., Tagliaferri, R., and Herrera, F. “Deep learning in video multi-object tracking: A survey.” Neurocomputing, Vol. 381, (2020), 61–88. https://doi.org/10.1016/j.neucom.2019.11.023
35.   Jodoin, J. P., Bilodeau, G. A., and Saunier, N. “Urban Tracker: Multiple object tracking in urban mixed traffic.” In 2014 IEEE Winter Conference on Applications of Computer Vision, WACV, (2014) 885–892. https://doi.org/10.1109/WACV.2014.6836010
36.   Bernardin, K., and Stiefelhagen, R. “Evaluating multiple object tracking performance: The CLEAR MOT metrics.” Eurasip Journal on Image and Video Processing, Vol. 2008, No. 1, (2008), 1–10. https://doi.org/10.1155/2008/246309
37.   Li, Y., Huang, C., and Nevatia, R. “Learning to associate: HybridBoosted multi-target tracker for crowded scene.” In 2009 IEEE Conference on Computer Vision and Pattern Recognition, (2009), 2953–2960. https://doi.org/10.1109/CVPR.2009.5206735
38.   Saunier, N., and Sayed, T. “A feature-based tracking algorithm for vehicles in intersections.” In Third Canadian Conference on Computer and Robot Vision, CRV (Vol. 2006), (2006), 59-65. https://doi.org/10.1109/CRV.2006.3
39.           Mendes, J. C., Gomes Campos Bianchi, A., and Júnior, Á. R. P. “Vehicle Tracking and Origin-destination Counting System for Urban Environment.” In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (2015), 600–607. https://doi.org/10.5220/0005317106000607
International Journal of Engineering
Volume 33, Issue 10
TRANSACTIONS A: Basics
October 2020
Pages 1939-1950

Files

Cited by

Share

How to cite

Statistics