journal article·2024-08-23Open access

Tomato Leaf Disease Classification by Combining EfficientNetv2 and a Swin Transformer

Yubing Sun, Lixin Ning, Bin Zhao, Jun Yan

Applied Sciences· Volume 14· Issue 17

Abstract

Recently, convolutional neural networks (CNNs) and self-attention mechanisms have been widely applied in plant disease identification tasks, yielding significant successes. Currently, the majority of research models for tomato leaf disease recognition rely solely on traditional convolutional models or Transformer architectures and fail to capture both local and global features simultaneously. This limitation may result in biases in the model’s focus, consequently impacting the accuracy of disease recognition. Consequently, models capable of extracting local features while attending to global information have emerged as a novel research direction. To address these challenges, we propose an Eff-Swin model that integrates the enhanced features of the EfficientNetV2 and Swin Transformer networks, aiming to harness the local feature extraction capability of CNNs and the global modeling ability of Transformers. Comparative experiments demonstrate that the enhanced model has achieved a further increase in training accuracy, reaching an accuracy rate of 99.70% on the tomato leaf disease dataset, which is 0.49~3.68% higher than that of individual network models and 0.8~1.15% higher than that of existing state-of-the-art combined approaches. The results show that integrating attention mechanisms into convolutional models can significantly enhance the accuracy of tomato leaf disease recognition while also offering the great potential of the Eff-Swin backbone with self-attention in plant disease identification.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Smart Agriculture and AI · Leaf Properties and Growth Measurement · Greenhouse Technology and Climate Control

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Information Science and Engineering, Shandong Agricultural University, Tai’an 271018, China

Funding

Shandong Province Higher Educational Program for Introduction and Cultivation of Young Innovative Talents in 2021 · National College Students’ innovation and entrepreneurship training program

References (29)

Show source-provided references
1. Li, T., Cui, J., Guo, W., She, Y., and Li, P. (2023). The Influence of Organic and Inorganic Fertilizer Applications on Nitrogen Transformation and Yield in Greenhouse Tomato Cultivation with Surface and Drip Irrigation Techniques. Water, 15.10.3390/w15203546 ↗
2. Research Progress of Crop Disease Image Recognition Based on Wireless Network Communication and Deep Learning10.1155/2021/7577349 ↗
3. Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification10.1155/2016/3289801 ↗
4. Liu, B., Zhang, Y., He, D.J., and Li, Y.X. (2018). Identification of Apple Leaf Diseases Based on Deep Convolutional Neural Networks. Symmetry, 10.10.3390/sym10010011 ↗
5. Deep learning based intelligence cognitive vision drone for automatic plant diseases identification and spraying10.3233/JIFS-189132 ↗
6. Identification of winter wheat pests and diseases based on improved convolutional neural network10.1515/biol-2022-0632 ↗
7. Zeng, T.W., Li, C.M., Zhang, B., Wang, R.R., Fu, W., Wang, J., and Zhang, X.R. (2022). Rubber Leaf Disease Recognition Based on Improved Deep Convolutional Neural Networks With a Cross-Scale Attention Mechanism. Front. Plant Sci., 13.10.3389/fpls.2022.829479 ↗
8. Tomato Leaf Disease Detection System Based on FC-SNDPN10.1007/s11042-021-11790-3 ↗
9. Zhang, Y., Liu, C.Q., Liu, M.J.X., Liu, T.Y., Lin, H., Huang, C.B., and Ning, L. (2024). Attention is all you need: Utilizing attention in AI-enabled drug discovery. Brief. Bioinform., 25.10.1093/bib/bbad467 ↗
10. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv.
11. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021). Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. arXiv.10.1109/ICCV48922.2021.00986 ↗
12. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
13. Mohanty, S.P., Hughes, D.P., and Salathé, M. (2016). Using Deep Learning for Image-Based Plant Disease Detection. Front. Plant Sci., 7.10.3389/fpls.2016.01419 ↗
14. “Tomato-Village”: A dataset for end-to-end tomato disease detection in a real-world environment10.1007/s00530-023-01158-y ↗
15. Conformer: Local Features Coupling Global Representations for Recognition and Detection10.1109/TPAMI.2023.3243048 ↗
16. Guo, J., Han, K., Wu, H., Tang, Y., Chen, X., Wang, Y., and Xu, C. (2021). CMT: Convolutional Neural Networks Meet Vision Transformers. arXiv.10.1109/CVPR52688.2022.01186 ↗
17. Nagamani, H.S., and Sarojadevi, H. (2022). Tomato leaf disease detection using deep learning techniques. Int. J. Adv. Comput. Sci. Appl., 13.10.14569/IJACSA.2022.0130138 ↗
18. Chen, Z., Wang, G., Lv, T., and Zhang, X. (2024). Using a Hybrid Convolutional Neural Network with a Transformer Model for Tomato Leaf Disease Detection. Agronomy, 14.10.3390/agronomy14040673 ↗
19. Can Deep Learning Identify Tomato Leaf Disease?10.1155/2018/6710865 ↗
20. ToLeD: Tomato leaf disease detection using convolution neural network10.1016/j.procs.2020.03.225 ↗
21. Elhassouny, A., and Smarandache, F. (2019, January 22–24). Smart mobile application to recognize tomato leaf diseases using Convolutional Neural Networks. Proceedings of the 2019 International Conference of Computer Science and Renewable Energies (ICCSRE), Agadir, Morocco.10.1109/ICCSRE.2019.8807737 ↗
22. Optimizing Pretrained Convolutional Neural Networks for Tomato Leaf Disease Detection10.1155/2020/8812019 ↗
23. Nithish Kannan, E., Kaushik, M., Prakash, P., Ajay, R., and Veni, S. (2020, January 10–12). Tomato leaf disease detection using convolutional neural network with data augmentation. Proceedings of the 2020 5th International Conference on Communication and Electronics Systems (ICCES), Coimbatore, India.
24. Tomato leaf disease classification using multiple feature extraction techniques10.1007/s11277-020-07590-x ↗
25. Identification of tomato leaf diseases based on combination of ABCK-BWTR and B-ARNet10.1016/j.compag.2020.105730 ↗
26. Automated tomato leaf disease classification using transfer learning-based deep convolution neural network10.1007/s41348-020-00403-0 ↗
27. Zhao, S.Y., Peng, Y., Liu, J.Z., and Wu, S. (2021). Tomato Leaf Disease Diagnosis Based on Improved Convolution Neural Network by Attention Module. Agriculture, 11.10.3390/agriculture11070651 ↗
28. Chen, H.C., Widodo, A.M., Wisnujati, A., Rahaman, M., Lin, J.C.W., Chen, L.K., and Weng, C.E. (2022). AlexNet Convolutional Neural Network for Disease Detection and Classification of Tomato Leaf. Electronics, 11.10.3390/electronics11060951 ↗
29. Peng, D., Li, W.J., Zhao, H.M., Zhou, G.X., and Cai, C. (2023). Recognition of Tomato Leaf Diseases Based on DIMPCNET. Agronomy, 13.10.3390/agronomy13071812 ↗