A Method for Automatic Lane Detection using a Deep Network

Document Type : Original Article

Authors

Department of Electronics, Faculty of Electrical Engineering, Shahrood University of Technology, Shahrood, Iran

Abstract

Lane detection is amongst the most important operations during the automatic driving process. This process aims to detect lane lines to control the vehicle’s direction in a specific lane on the road and it can be effective in preventing accidents. Besides being online, the most requirement for lane detection methods in automatic driving is their high accuracy. The use of deep learning to create fully automated systems in lane detection has been done extensively. Automated learning-based methods used for road lane detection are often of supervised type. One of the disadvantages of these methods, despite their excellent accuracy, is that they need a set of labeled data, which limits the development procedure of the lane detection system, and most importantly establishing a standard set of labeled data is very time-demanding. The recommended solution is to use appropriate learning approaches that can be used to achieve the relative accuracy of the supervised approaches and to improve their speed. It also enables us to use different datasets without a constraint label that the tagged dataset would create in the algorithm development relative to the new dataset. In this research, we present an automatic semi-supervised learning method using deep neural networks to extract the data of lane lines, using labeled (mask for detected lines) and unlabeled datasets. The results demonstrate the suitable accuracy of the adopted method according to the proposed approach and also improves its computational complexity due to the significant reduction in the number of teachable network parameters.

Keywords

Main Subjects

References

  1. Garnett, N., Cohen, R., Pe'er, T., Lahav, R., Levi, D., "3d-lanenet: end-to-end 3d multiple lane detection", In Proceedings of the IEEE/CVF International Conference on Computer Vision, (2019), 2921-2930.
  2. Cudrano, P., Mentasti, S., Matteucci, M., Bersani, M., Arrigoni, S., Cheli, F., "Advances in centerline estimation for autonomous lateral control", In 2020 IEEE Intelligent Vehicles Symposium (IV), (2020), 1415-1422, doi: 1109/IV47402.2020.9304729.
  3. Huval, B., Wang, T., Tandon, S., Kiske, J., Song, W., Pazhayampallil, J., Andriluka, M., Rajpurkar, P., Migimatsu, T., Cheng-Yue, R., Mujica, F., "An empirical evaluation of deep learning on highway driving", arXiv preprint arXiv, (2015).
  4. Lee, S., Kim, J., Shin Yoon, J., Shin, S., Bailo, O., Kim, N., Lee, T.H., Seok Hong, H., Han, SH., So Kweon, I., "Vpgnet: Vanishing point guided network for lane and road marking detection and recognition", In Proceedings of the IEEE International Conference on Computer Vision, (2017), 1947-1955.
  5. Pourasad, Y., "Optimal Control of the Vehicle Path Following by Using Image Processing Approach", International Journal of Engineering, Transactions C: Aspects, Vol. 31, No. 9, (2018), 1559-1567, doi: 10.5829/ije.2018.31.09c.12.
  6. Feizi, A., "Convolutional gating network for object tracking", International Journal of Engineering, Transactions A: Basics, 32, No. 7, (2019), 931-939, doi: 10.5829/ije.2019.32.07a.05.
  7. Righettini, P., Roberto S., "Driving Technologies for the Design of Additive Manufacturing Systems", HighTech and Innovation Journal, Vol. 2, No.1, (2021), 20-28, doi: 10.28991/HIJ-2021-02-01-03.
  8. Kapeller, H., Dominik D., Dragan S., "Improvement and Investigation of the Requirements for Electric Vehicles by the use of HVAC Modeling", HighTech and Innovation Journal, Vol. 2, No. 1, (2021), 67-76, doi: 10.28991/HIJ-2021-02-01-07.
  9. Lee, D.H., Liu, J.L., "End-to-End Deep Learning of Lane Detection and Path Prediction for Real-Time Autonomous Driving", arXiv preprint arXiv, (2021).
  10. Yenikaya, S., Yenikaya, G., Düven, E., "Keeping the vehicle on the road: A survey on on-road lane detection systems", ACM Computing Surveys (CSUR), (2013), 1-43, doi: 10.1145/2522968.2522970.
  11. Zhang, Y., Lu, Z., Zhang, X., Xue, J.H., Liao, Q., "Deep Learning in Lane Marking Detection: A Survey", IEEE Transactions on Intelligent Transportation Systems, (2021), doi: 10.1109/TITS.2021.3070111.
  12. Feniche, M., Mazri, T., "Lane detection and tracking for intelligent vehicles: A survey", In 2019 International Conference of Computer Science and Renewable Energies (ICCSRE), (2019), 1-4, doi: 10.1109/ICCSRE.2019.8807727.
  13. Hillel, A.B., Lerner, R., Levi, D., Raz, G., "Recent progress in road and lane detection: a survey", Machine Vision and Applications, (2014), 727-745, doi: 10.1007/s00138-011-0404-2.
  14. Liang, D., Guo, Y.C., Zhang, S.K., Mu, T.J., Huang, X., "Lane detection: a survey with new results", Journal of Computer Science and Technology, (2020), 493-505, doi: 10.1007/s11390-020-0476-4.
  15. Oliveira, G.L., Burgard, W., Brox, T., "Efficient deep models for monocular road segmentation", In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), (2016), 4885-4891, doi: 10.1109/IROS.2016.7759717.
  16. Liu, X., Deng, Z., Yang, G., "Drivable road detection based on dilated FPN with feature aggregation." In 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI), (2017), 1128-1134, doi: 10.1109/ICTAI.2017.00172.
  17. Mamidala, R.S., Uthkota, U., Shankar, M.B., Antony, A.J., Narasimhadhan, A.V., "Dynamic approach for lane detection using Google Street view and CNN", 2019 IEEE Region 10 Conference (TENCON), (2019), 2454-2459, doi: 10.1109/TENCON.2019.8929655.
  18. Li, J., Mei, X., Prokhorov, D., Tao, D., "Deep neural network for structural prediction and lane detection in traffic scene", IEEE Transactions on Neural Networks and Learning Systems, (2016), 690-703, doi: 10.1109/TNNLS.2016.2522428.
  19. Hou, Y., Ma, Z., Liu, C., Loy, C.C., "Learning lightweight lane detection cnns by self attention distillation", In Proceedings of the IEEE/CVF International Conference on Computer Vision, (2019), 1013-1021.
  20. He, B., Ai, R., Yan, Y., Lang, X., "Accurate and robust lane detection based on dual-view convolutional neutral network", In 2016 IEEE Intelligent Vehicles Symposium (IV), (2016), 1041-1046, doi: 10.1109/IVS.2016.7535517.
  21. Bai, M., Mattyus, G., Homayounfar, N., Wang, S., Lakshmikanth, S.K., Urtasun, R., "Deep multi-sensor lane detection", In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), (2018), 3102-3109, doi: 10.1109/IROS.2018.8594388
  22. Satti, S.K., Devi, K.S., Dhar, P., Srinivasan, P., "A machine learning approach for detecting and tracking road boundary lanes", ICT Express, Vol. 7, No. 1, (2021), 99-103, doi: 1016/j.icte.2020.07.007.
  23. Wang, W., Lin, H., Wang, J., "CNN based lane detection with instance segmentation in edge-cloud computing", Journal of Cloud Computing, (2020), 1-10, doi: 10.1186/s13677-020-00172-z.
  24. Zou, Q., Jiang, H., Dai, Q., Yue, Y., Chen, L., Wang, Q., "Robust lane detection from continuous driving scenes using deep neural networks", IEEE Transactions on Vehicular Technology, (2019), 41-54, doi: 10.1109/TVT.2019.2949603.
  25. Khosravian, E., Maghsoudi, H., "Design of an Intelligent Controller for Station Keeping, Attitude Control, and Path Tracking of a Quadrotor Using Recursive Neural Networks", International Journal of Engineering, Transactions B: Applications, 32, No. 5, (2019), 747-758, doi: 10.5829/ije.2019.32.05b.17.
  26. Prenga, D., "General features of the q-XY opinion model" Journal of Human, Earth, and Future, Vol. 1, No. 2, (2020), 87-96, doi: 10.28991/HEF-2020-01-02-05.
  27. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y., "Generative adversarial nets", Advances in Neural Information Processing Systems, (2014).
  28. Odena, A., "Semi-supervised learning with generative adversarial networks", arXiv preprint arXiv, (2016).
  29. Namjoy, A., Bosaghzadeh, A., "A Sample Dependent Decision Fusion Algorithm for Graph-based Semi-supervised Learning" International Journal of Engineering, Transactions B: Applications, Vol. 33, No. 5 (2020), 1010-1019, doi: 10.5829/ije.2020.33.05b.35.
  30. Souly, N., Spampinato, C., Shah, M., "Semi supervised semantic segmentation using generative adversarial network", In Proceedings of the IEEE International Conference on Computer Vision, (2017), 5688-5696.
International Journal of Engineering
Volume 35, Issue 4
TRANSACTIONS A: Basics
April 2022
Pages 802-809

Files

Cited by

Share

How to cite

Statistics