Grape (Vitis Vinifera) Leaf Disease Detection and Classification Using Deep Learning Techniques: A Study on Real-Time Grape Leaf Image Dataset in India

Document Type : Original Article

Authors

Symbiosis Institute of Geoinformatics, Symbiosis International (Deemed University), Pune, India

Abstract

In modern horticulture, the grape industry across the globe has been coping with the issue of grape crop diseases. The detection of grape leaf diseases using automated methods can greatly assist farmers in mitigating yield losses and ensuring sustainability. However, existing systems face hurdles while handling grape leaf images at the farm level, and these models fail to generalize well on un-seen images. This study proposes the development of a well-curated real-time dataset of grape leaf images assimilated through field visits in the study area in India. This designed dataset is further used to train convolutional neural network models to accurately identify and classify grape leaves as either diseased or healthy. The potential of transfer learning using CNN models like VGG, ResNet, Inception, and Xception is assessed on the curated dataset. Our findings indicate that ResNet50V2 outperformed the other models in accurately identifying and classifying grape leaf diseases. Using transfer learning, existing weights (pre-trained) and learned features were utilized for further training and fine-tuning the CNN models on our curated dataset.  The results of the proposed approach are compared with existing automated grape leaf disease identification techniques. It is observed that the proposed approach, which is on a real-time grape leaf image dataset, provides the highest accuracy among others. Further, this study provides a well-curated dataset of on-field grape leaf images in the Indian context, which can serve as a benchmark for future research. This study shows that deep learning techniques can aid farmers in identifying grape leaf diseases early.  

Graphical Abstract

Grape (Vitis Vinifera) Leaf Disease Detection and Classification Using Deep Learning Techniques: A Study on Real-Time Grape Leaf Image Dataset in India

Keywords

Main Subjects


  1. Gerland P, Raftery AE, Ševčíková H, Li N, Gu D, Spoorenberg T, et al. World population stabilization unlikely this century. Science. 2014;346(6206):234-7. 10.1126/science.1257469
  2. Statistics H. Horticulture Statistics at a Glance. Horticulture Statistics Division, Department of Agriculture, Cooperation and Farmers Welfare, Ministry of Agriculture and Farmers Welfare, Government of India, New Delhi. 2018. https://agricoop.nic.in/en/statistics/horticulture
  3. Liu B, Ding Z, Tian L, He D, Li S, Wang H. Grape leaf disease identification using improved deep convolutional neural networks. Frontiers in Plant Science. 2020;11:1082. 10.3389/fpls.2020.01082
  4. Xie X, Ma Y, Liu B, He J, Li S, Wang H. A deep-learning-based real-time detector for grape leaf diseases using improved convolutional neural networks. Frontiers in plant science. 2020;11:751. 10.3389/fpls.2020.00751
  5. Jha K, Doshi A, Patel P, Shah M. A comprehensive review on automation in agriculture using artificial intelligence. Artificial Intelligence in Agriculture. 2019;2:1-12. 10.1016/j.aiia.2019.05.004
  6. Rajbongshi A, Islam M, Mia M, Sakif T, Majumder A. A comprehensive investigation to cauliflower diseases recognition: an automated machine learning approach. International Journal on Advanced Science, Engineering and Information Technology. 2022;12(1):32-41. 10.18517/ijaseit.12.1.15189
  7. Santos L, Santos FN, Oliveira PM, Shinde P, editors. Deep learning applications in agriculture: A short review. Robot 2019: Fourth Iberian Robotics Conference: Advances in Robotics, Volume 1; 2020: Springer. 10.1007/978-3-030-35990-4_12
  8. Udendhran R, Balamurugan M. RETRACTED ARTICLE: Towards secure deep learning architecture for smart farming-based applications. Complex & Intelligent Systems. 2021;7(2):659-66. 10.1007/s40747-020-00225-5
  9. Bawage S, Momin B. Detection of Diseases on Crops & Design of Recommendation Engine: A Review. Information and Communication Technology for Intelligent Systems (ICTIS 2017)-Volume 1 2. 2018:390-8. 10.1007/978-3-319-63673-3_48
  10. Kartikeyan P, Shrivastava G. Review on emerging trends in detection of plant diseases using image processing with machine learning. Int J Comput Appl. 2021;174(11):39-48. 10.5120/ijca2021920990
  11. Nagaraju M, Chawla P. Systematic review of deep learning techniques in plant disease detection. International journal of system assurance engineering and management. 2020;11(3):547-60. 10.1007/s13198-020-00972-1
  12. Alruwaili M, Abd El-Ghany S, Shehab A. An enhanced plant disease classifier model based on deep learning techniques. International Journal of Advanced Technology and Engineering Exploration. 2019;9(1):10.35940. 10.35940/ijeat.A1907.109119
  13. Shantkumari M, Uma S. Machine learning techniques implementation for detection of grape leaf disease. Multimedia tools and applications. 2023;82(20):30709-31. 10.1007/s11042-023-14441-x
  14. Ashokkumar K, Parthasarathy S, Nandhini S, Ananthajothi K. Prediction of grape leaf through digital image using FRCNN. Measurement: Sensors. 2022;24:100447. 10.1016/j.measen.2022.100447
  15. Ansari AS, Jawarneh M, Ritonga M, Jamwal P, Mohammadi MS, Veluri RK, et al. Improved support vector machine and image processing enabled methodology for detection and classification of grape leaf disease. Journal of Food Quality. 2022;2022. 10.1155/2022/9502475
  16. Lin J, Chen X, Pan R, Cao T, Cai J, Chen Y, et al. Grapenet: A lightweight convolutional neural network model for identification of grape leaf diseases. Agriculture. 2022;12(6):887. 10.3390/agriculture12060887
  17. Phukhronghin K, Muangklang E, Somwang P, Kosum K, Promarin K, Kogphimai D, editors. Grape Leaf Disease Diagnosis using Convolutional Neural Network and Support Vector Machines. 2022 19th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON); 2022: IEEE. 10.1109/ECTI-CON54298.2022.9795611
  18. Arsenovic M, Karanovic M, Sladojevic S, Anderla A, Stefanovic D. Solving current limitations of deep learning based approaches for plant disease detection. Symmetry. 2019;11(7):939. 10.3390/sym11070939
  19. Kamilaris A, Prenafeta-Boldú FX. Deep learning in agriculture: A survey. Computers and electronics in agriculture. 2018;147:70-90. 10.1016/j.compag.2018.02.016
  20. Alzubaidi L, Zhang J, Humaidi AJ, Al-Dujaili A, Duan Y, Al-Shamma O, et al. Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Journal of big Data. 2021;8:1-74. https://doi.org/10.1186/s40537-021-00444-8
  21. Jogekar R, Tiwari N, editors. Summary of Leaf-based plant disease detection systems: A compilation of systematic study findings to classify the leaf disease classification schemes. 2020 fourth world conference on smart trends in systems, security and sustainability (WorldS4); 2020: IEEE. 10.1109/WorldS450073.2020.9210401
  22. Khan RU, Khan K, Albattah W, Qamar AM. Image-based detection of plant diseases: from classical machine learning to deep learning journey. Wireless Communications and Mobile Computing. 2021;2021:1-13. 10.1155/2021/5541859
  23. Doh B, Zhang D, Shen Y, Hussain F, Doh RF, Ayepah K, editors. Automatic citrus fruit disease detection by phenotyping using machine learning. 2019 25th International conference on automation and computing (ICAC); 2019: IEEE. 10.23919/IConAC.2019.8895102
  24. Chandra AL, Desai SV, Guo W, Balasubramanian VN. Computer vision with deep learning for plant phenotyping in agriculture: A survey. arXiv preprint arXiv:200611391. 2020. 10.34048/acc.2020.1. f1
  25. Hinton GE, Osindero S, Teh Y-W. A fast learning algorithm for deep belief nets. Neural computation. 2006;18(7):1527-54. 10.1162/neco.2006.18.7.1527
  26. Fuentes A, Yoon S, Kim SC, Park DS. A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors. 2017;17(9):2022. 10.3390/s17092022
  27. Joshi RC, Kaushik M, Dutta MK, Srivastava A, Choudhary N. VirLeafNet: Automatic analysis and viral disease diagnosis using deep-learning in Vigna mungo plant. Ecological Informatics. 2021;61:101197. 10.1016/j.ecoinf.2020.101197
  28. Fenu G, Malloci FM. Using multioutput learning to diagnose plant disease and stress severity. Complexity. 2021;2021:1-11. 10.1155/2021/6663442
  29. Vashisht S, Kumar P, Trivedi MC, editors. Design of a predictive measure to enhance neural network architecture for plant disease detection. Proceedings of International Conference on Big Data, Machine Learning and their Applications: ICBMA 2019; 2021: Springer. 10.1007/978-981-15-8377-3_12
  30. Ahmad I, Hamid M, Yousaf S, Shah ST, Ahmad MO. Optimizing pretrained convolutional neural networks for tomato leaf disease detection. Complexity. 2020;2020:1-6. 10.1155/2020/8812019
  31. Boulent J, Foucher S, Théau J, St-Charles P-L. Convolutional neural networks for the automatic identification of plant diseases. Frontiers in plant science. 2019;10:464450. 10.3389/fpls.2019.00941
  32. Liu B, Zhang Y, He D, Li Y. Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry. 2017;10(1):11. 10.3390/sym10010011
  33. Suma V, Shetty RA, Tated RF, Rohan S, Pujar TS, editors. CNN based leaf disease identification and remedy recommendation system. 2019 3rd International conference on Electronics, Communication and Aerospace Technology (ICECA); 2019: IEEE. 10.1109/ICECA.2019.8821872
  34. Morbekar A, Parihar A, Jadhav R, editors. Crop disease detection using YOLO. 2020 international conference for emerging technology (INCET); 2020: IEEE. 10.1109/INCET49848.2020.9153986
  35. Ponnusamy V, Coumaran A, Shunmugam AS, Rajaram K, Senthilvelavan S, editors. Smart glass: real-time leaf disease detection using YOLO transfer learning. 2020 International Conference on Communication and Signal Processing (ICCSP); 2020: IEEE. 10.1109/ICCSP48568.2020.9182146
  36. Huayhongthong P, Rerk-u-suk S, Booddee S, Padungweang P, Warasup K, editors. Incremental Object Detection Using Ensemble Modeling and Deep Transfer Learning. Recent Advances in Information and Communication Technology 2020: Proceedings of the 16th International Conference on Computing and Information Technology (IC2IT 2020); 2020: Springer. 10.1007/978-3-030-44044-2_19
  37. Mohanty SP, Hughes DP, Salathé M. Using deep learning for image-based plant disease detection. Frontiers in plant science. 2016;7:215232. 10.3389/fpls.2016.01419
  38. Singh D, Jain N, Jain P, Kayal P, Kumawat S, Batra N. PlantDoc: A dataset for visual plant disease detection. Proceedings of the 7th ACM IKDD CoDS and 25th COMAD2020. p. 249-53.
  39. Lu Y, Young S. A survey of public datasets for computer vision tasks in precision agriculture. Computers and Electronics in Agriculture. 2020;178:105760. 10.1016/j.compag.2020.105760
  40. Bloice MD, Stocker C, Holzinger A. Augmentor: an image augmentation library for machine learning. arXiv preprint arXiv:170804680. 2017. 10.48550/arXiv.1708.04680
  41. Weiss K, Khoshgoftaar TM, Wang D. A survey of transfer learning. Journal of Big data. 2016;3:1-40. 10.1186/s40537-016-0043-6
  42. Yuan L, Chen Y, Wang T, Yu W, Shi Y, Jiang Z-H, et al., editors. Tokens-to-token vit: Training vision transformers from scratch on imagenet. Proceedings of the IEEE/CVF international conference on computer vision; 2021. 10.1109/ICCV48922.2021.00060
  43. Tan C, Sun F, Kong T, Zhang W, Yang C, Liu C, editors. A survey on deep transfer learning. Artificial Neural Networks and Machine Learning–ICANN 2018: 27th International Conference on Artificial Neural Networks, Rhodes, Greece, October 4-7, 2018, Proceedings, Part III 27; 2018: Springer. 10.1007/978-3-030-01424-7_27
  44. Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L, editors. Imagenet: A large-scale hierarchical image database. 2009 IEEE conference on computer vision and pattern recognition; 2009: Ieee. 10.1109/CVPR.2009.5206848
  45. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556. 2014. 10.48550/arXiv.1409.1556
  46. Bahrampour S, Ramakrishnan N, Schott L, Shah M. Comparative study of deep learning software frameworks. arXiv preprint arXiv:151106435. 2015. 10.48550/arXiv.1511.06435
  47. Carneiro T, Da Nóbrega RVM, Nepomuceno T, Bian G-B, De Albuquerque VHC, Reboucas Filho PP. Performance analysis of google colaboratory as a tool for accelerating deep learning applications. Ieee Access. 2018;6:61677-85. 10.1109/ACCESS.2018.2874767
  48. Too EC, Yujian L, Njuki S, Yingchun L. A comparative study of fine-tuning deep learning models for plant disease identification. Computers and Electronics in Agriculture. 2019;161:272-9. 10.1016/j.compag.2018.03.032
  49. Tang Y. TF. Learn: TensorFlow's high-level module for distributed machine learning. arXiv preprint arXiv:161204251. 2016. 10.48550/arXiv.1612.04251
  50. Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:160304467. 2016. 10.48550/arXiv.1603.04467
  51. Jin H, Li Y, Qi J, Feng J, Tian D, Mu W. GrapeGAN: Unsupervised image enhancement for improved grape leaf disease recognition. Computers and Electronics in Agriculture. 2022;198:107055. 10.1016/j.compag.2022.107055
  52. Shantkumari M, Uma S. Grape leaf image classification based on machine learning technique for accurate leaf disease detection. Multimedia tools and applications. 2023;82(1):1477-87. 10.1007/s11042-022-12976-z
  53. Guo W, Feng Q, Li X, Yang S, Yang J. Grape leaf disease detection based on attention mechanisms. International Journal of Agricultural and Biological Engineering. 2022;15(5):205-12. 10.25165/j.ijabe.20221505.7548
  54. Pawar A, Singh M, Jadhav S, Kumbhar V, Singh T, Shah SK, editors. Different Crop Leaf Disease Detection Using Convolutional Neural Network. International Conference on Applications of Machine Intelligence and Data Analytics (ICAMIDA 2022); 2023: Atlantis Press. 10.2991/978-94-6463-136-4_85
  55. Mavaddati S. Rice classification and quality detection based on sparse coding technique. International Journal of Engineering. 2018;31(11):1910-7. 10.5829/ije.2018.31.11b.15
  56. Javidan SM, Banakar A, Vakilian KA, Ampatzidis Y. Diagnosis of grape leaf diseases using automatic K-means clustering and machine learning. Smart Agricultural Technology. 2023;3:100081. 10.1016/j.atech.2022.100081
  57. Pal A, Kumar V. AgriDet: Plant Leaf Disease severity classification using agriculture detection framework. Engineering Applications of Artificial Intelligence. 2023;119:105754. 10.1016/j.engappai.2022.105754
  58. Sharma V, Tripathi AK, Mittal H. DLMC-Net: Deeper lightweight multi-class classification model for plant leaf disease detection. Ecological informatics. 2023;75:102025. 10.1016/j.ecoinf.2023.102025
  59. Rohani M, Farsi H, Mohamadzadeh S. Deep Multi-task Convolutional Neural Networks for Efficient Classification of Face Attributes. International Journal of Engineering, Transactions B: Applications. 2023;36(11):2102-11. 10.5829/ije.2023.36.11b.14
  60. Gaurav K, Kumar A, Singh P, Kumari A, Kasar M, Suryawanshi T. Human Disease Prediction using Machine Learning Techniques and Real-life Parameters. International Journal of Engineering, Transactions C: Aspects. 2023;36(6):1092-8. 10.5829/ije.2023.36.06c.07
  61. Farhoodi M, Toloie Eshlaghy A, Motadel M. A Proposed Model for Persian Stance Detection on Social Media. International Journal of Engineering, Transactions C: Aspects. 2023;36(6):1048-59. 10.5829/ije.2023.36.06c.03