LBFNet: A Tomato Leaf Disease Identification Model Based on Three-Channel Attention Mechanism and Quantitative Pruning
Source abstract
Abstract
The current neural networks for tomato leaf disease recognition have problems such as large model parameters, long training time, and low model accuracy. To solve these problems, a lightweight convolutional neural network (LBFNet) is proposed in this paper. First, LBFNet is established as the base model. Secondly, a three-channel attention mechanism module is introduced to learn the disease features in tomato leaf disease images and reduce the interference of redundant features. Finally, a cascade module is introduced to increase the depth of the model, solve the gradient descent problem, and reduce the loss caused by increasing the depth of the model. The quantized pruning technique is also used to further compress the model parameters and optimize the model performance. The results show that the LBFNet model achieves 99.06% accuracy on the LBFtomato dataset, with a training time of 996 s and a single classification accuracy of over 94%. Further training using the saved weight file after quantized pruning enables the model accuracy to reach 97.66%. Compared with the base model, the model accuracy was improved by 28%, and the model parameters were reduced by 96.7% compared with the traditional Resnet50. It was found that LBFNet can quickly and accurately identify tomato leaf diseases in complex environments, providing effective assistance to agricultural producers.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI · Leaf Properties and Growth Measurement · Greenhouse Technology and Climate Control
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Information and Intelligence, Hunan Agricultural University, Changsha 410128, China
College of Mechanical and Electrical Engineering, Hunan Agricultural University, Changsha 410128, China
Funding
National Key R&D Program of China
References (42)
Show source-provided references
1. Plant diseases and pests detection based on deep learning: A review10.1186/s13007-021-00722-9 ↗
2. Plant diseases recognition on images using convolutional neural networks: A systematic review10.1016/j.compag.2021.106125 ↗
3. A review of the use of convolutional neural networks in agriculture10.1017/S0021859618000436 ↗
4. Towards automatic field plant disease recognition10.1016/j.compag.2021.106523 ↗
5. Yang, C., Teng, Z., Dong, C., Lin, Y., Chen, R., and Wang, J. (2022). In-Field Citrus Disease Classification via Convolutional Neural Network from Smartphone Images. Agriculture, 12.10.3390/agriculture12091487 ↗
6. A VGG-19 Model with Transfer Learning and Image Segmentation for Classification of Tomato Leaf Disease10.3390/agriengineering4040056 ↗
7. Citrus fruits maturity detection in natural environments based on convolutional neural networks and visual saliency map10.1007/s11119-022-09895-2 ↗
8. Deep convolutional neural network based detection system for real-time corn plant disease recognition10.1016/j.procs.2020.03.236 ↗
9. Automatic recognition of strawberry diseases and pests using convolutional neural network10.1016/j.atech.2021.100009 ↗
10. Detection and classification of tea buds based on deep learning10.1016/j.compag.2021.106547 ↗
11. EFDet: An efficient detection method for cucumber disease under natural complex environments10.1016/j.compag.2021.106378 ↗
12. Chen, J., Liu, Q., and Gao, L. (2019). Visual tea leaf disease recognition using a convolutional neural network model. Symmetry, 11.10.3390/sym11030343 ↗
13. Hybrid feature-based disease detection in plant leaf using convolutional neural network, bayesian optimized SVM, and random forest classifier10.1155/2022/2845320 ↗
14. Plant disease recognition based on plant leaf image
15. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. (2017, January 4–9). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the AAAI, San Francisco, CA, USA.10.1609/aaai.v31i1.11231 ↗
16. Tomato plant disease detection using transfer learning with C-GAN synthetic images10.1016/j.compag.2021.106279 ↗
17. Huang, G., Liu, Z., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
18. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
19. Ding, X., Zhang, X., Ma, N., Han, J., Ding, G., and Sun, J. (2021, January 11–17). Repvgg: Making vgg-style convnets great again. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Montreal, QC, Canada.10.1109/CVPR46437.2021.01352 ↗
20. Crop leaf disease recognition based on Self-Attention convolutional neural network10.1016/j.compag.2020.105341 ↗
21. Deng, H., Luo, D., Chang, Z., Li, H., and Yang, X. (2021). RAHC_GAN: A Data Augmentation Method for Tomato Leaf Disease Recognition. Symmetry, 13.10.3390/sym13091597 ↗
22. Gong, C., Wang, D., Li, M., Chandra, V., and Liu, Q. (2021, January 11–17). Keep Augment: A simple information-preserving data augmentation approach. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Montreal, QC, Canada.10.1109/CVPR46437.2021.00111 ↗
23. Multilayer feature fusion and attention-based network for crops and weeds segmentation10.1007/s41348-022-00663-y ↗
24. Identification of wormholes in soybean leaves based on multi-feature structure and attention mechanism10.1007/s41348-022-00694-5 ↗
25. AVNC: Attention-based VGG-style network for COVID-19 diagnosis by three-channel attention mechanism10.1109/JSEN.2021.3062442 ↗
26. Fukui, H., Hirakawa, T., Yamashita, T., and Fujiyoshi, H. (2019, January 15–20). Attention branch network: Learning of attention mechanism for visual explanation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01096 ↗
27. Chefer, H., Gur, S., and Wolf, L. (2021, January 11–17). Transformer interpretability beyond attention visualization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Montreal, QC, Canada.10.1109/CVPR46437.2021.00084 ↗
28. Attention mechanisms in computer vision: A survey10.1007/s41095-022-0271-y ↗
29. A novel PCA–whale optimization-based deep neural network model for classification of tomato plant diseases using GPU10.1007/s11554-020-00987-8 ↗
30. Disease detection in tomato leaves via CNN with lightweight architectures implemented in Raspberry Pi 410.1016/j.compag.2020.105951 ↗
31. Tomato crop disease classification using pre-trained deep learning algorithm10.1016/j.procs.2018.07.070 ↗
32. Identification of tomato disease types and detection of infected areas based on deep convolutional neural networks and object detection techniques10.1155/2019/9142753 ↗
33. Deep learning-based object detection improvement for tomato disease10.1109/ACCESS.2020.2982456 ↗
34. Chakravarthy, A.S., and Raman, S. (2020, January 5–7). Early blight identification in tomato leaves using deep learning. Proceedings of the 2020 International conference on contemporary computing and applications (IC3A), Lucknow, India.10.1109/IC3A48958.2020.233288 ↗
35. Less is more: Lighter and faster deep neural architecture for tomato leaf disease classification10.1109/ACCESS.2022.3187203 ↗
36. Optimized deep residual network system for diagnosing tomato pests10.1016/j.compag.2022.106805 ↗
37. Singh, D., Jain, N., Jain, P., Kayal, P., Kumawat, S., and Batra, N. (2020, January 5–7). PlantDoc: A dataset for visual plant disease detection. Proceedings of the 7th ACM IKDD CoDS and 25th COMAD, Hyderabad, India.10.1145/3371158.3371196 ↗
38. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
39. Karen, S., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
40. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2014). Going Deeper with Convolutions. arXiv.10.1109/CVPR.2015.7298594 ↗
41. Alexey, D., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 × 16 words: Transformers for image recognition at scale. arXiv.
42. Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., and Xie, S. A ConvNet for the 2020s. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01167 ↗