Leaf Spot Attention Networks Based on Spot Feature Encoding for Leaf Disease Identification and Detection
Source abstract
Abstract
This study proposes a new attention-enhanced YOLO model that incorporates a leaf spot attention mechanism based on regions-of-interest (ROI) feature extraction into the YOLO framework for leaf disease detection. Inspired by a previous study, which revealed that leaf spot attention based on the ROI-aware feature extraction can improve leaf disease recognition accuracy significantly and outperform state-of-the-art deep learning models, this study extends the leaf spot attention model to leaf disease detection. The primary idea is that spot areas indicating leaf diseases appear only in leaves, whereas the background area does not contain useful information regarding leaf diseases. To increase the discriminative power of the feature extractor that is required in the object detection framework, it is essential to extract informative and discriminative features from the spot and leaf areas. To realize this, a new ROI-aware feature extractor, that is, a spot feature extractor was designed. To divide the leaf image into spot, leaf, and background areas, the leaf segmentation module was first pretrained, and then spot feature encoding was applied to encode spot information. Next, the ROI-aware feature extractor was connected to an ROI-aware feature fusion layer to model the leaf spot attention mechanism, and to be joined with the YOLO detection subnetwork. The experimental results confirm that the proposed ROI-aware feature extractor can improve leaf disease detection by boosting the discriminative power of the spot features. In addition, the proposed attention-enhanced YOLO model outperforms conventional state-of-the-art object detection models.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI · Plant Virus Research Studies · Leaf Properties and Growth Measurement
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Software Convergence Engineering, Kunsan National University, Gunsan 54150, Korea
Funding
Cooperative Research Program for Agriculture Science & Technology Development
References (46)
Show source-provided references
1. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). Imagenet Classification with Deep Convolutional Neural Networks. Proceedings of the Neural Information Processing Systems, Harrah’s Lake Tahoe, NV, USA.
2. Distinct image features from scale-invariant key points10.1023/B:VISI.0000029664.99615.94 ↗
3. A completed modeling of local binary pattern operator for texture classification10.1109/TIP.2010.2044957 ↗
4. Yang, J., Yu, K., Gong, Y., and Huang, T. (2009, January 20–25). Linear Spatial Pyramid Matching Using Sparse Coding for Image Classification. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.
5. Detection of plant leaf diseases using image segmentation and soft computing techniques
6. Lazebnik, S., Schmid, C., and Ponce, J. (2006, January 17–22). Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, New York, NY, USA.
7. Perronnin, F., and Dance, C. (2007, January 18–23). Fisher Kernels on Visual Vocabularies for Image Categorization. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.10.1109/CVPR.2007.383266 ↗
8. Support-vector networks10.1007/BF00994018 ↗
9. Islam, M., Dinh, A., and Wahid, K. (May, January 30). Detection of potato diseases using image segmentation and multiclass support vector machine. Proceedings of the IEEE Canadian Conference on Electrical and Computer Engineering, Windsor, ON, Canada.
10. Induction of decision trees10.1007/BF00116251 ↗
11. Apple leaf disease identification using genetic algorithm and correlation based feature selection method
12. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation10.1109/TSP.2006.881199 ↗
13. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
14. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
15. Deep learning models for plant disease detection and diagnosis10.1016/j.compag.2018.01.009 ↗
16. Fuentes, A., Yoon, S., Kim, S.C., and Park, D.S. (2017). A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors, 17.10.3390/s17092022 ↗
17. Using deep learning for image-based plant disease detection10.3389/fpls.2016.01419 ↗
18. Identification of rice diseases using deep convolutional neural networks10.1016/j.neucom.2017.06.023 ↗
19. Automatic recognition of soybean leaf diseases using UAV images and deep convolutional neural networks10.1109/LGRS.2019.2932385 ↗
20. Bjerge, K., Nielsen, J.B., Sepstrup, M.V., Helsing-Nielsen, F., and Hoye, T.T. (2021). An automated light trap to monitor moths (Lepidoptera) using computer vision-based tracking and deep learning. Sensors, 21.10.3390/s21020343 ↗
21. A detection and severity estimation system for generic diseases of tomato greeenhouse plants10.1016/j.compag.2020.105701 ↗
22. Attention gated networks: Learning to leverage salient regions in medical images10.1016/j.media.2019.01.012 ↗
23. Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 22–25). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
24. Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., and Shao, L. (2021). Pyramid vision transformer: A versatile backbone for dense prediction without convolutions. arXiv.10.1109/ICCV48922.2021.00061 ↗
25. Kumar, N., Belhumeur, P.N., Biswa, A., Jacobs, D.W., Kress, W.J., Lopez, I., and Soares, J. (2012, January 7–13). Leafsnap: A Computer Vision System for Automatic Plant Species Identification. Proceedings of the European Conference on Computer Vision, Florence Italy.10.1007/978-3-642-33709-3_36 ↗
26. Dalal, N., and Triggs, B. (2005, January 20–25). Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA.
27. Selective search for object recognition10.1007/s11263-013-0620-5 ↗
28. SLIC superpixels compared to state-of-the-art superpixel methods10.1109/TPAMI.2012.120 ↗
29. Zitnick, C.L., and Dollár, P. (2014, January 8–11). Edge Boxes: Locating Object Proposals from Edges. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10602-1_26 ↗
30. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
31. Girshick, R. (2015, January 7–13). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
32. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
33. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only Look Once: Unified, Realtime Object Detection. Proceedings of the IEEE Conference Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
34. Liu, W., Anguelov, D., Drhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 8–16). SSD: Single Shot Multibox Detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
35. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
36. Cai, Z., and Vasconcelos, N. (2018, January 18–23). Cascade R-CNN: Delving into High Quality Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00644 ↗
37. Real-time detection of apple leaf diseases using deep learning approach based on improved convolutional neural networks10.1109/ACCESS.2019.2914929 ↗
38. Apple detection during different growth stages in orchards using improved YOLO-V3 model10.1016/j.compag.2019.01.012 ↗
39. Symptom based automated detection of citrus diseases using color histogram and textural descriptors10.1016/j.compag.2017.04.008 ↗
40. Yu, H.-J., and Son, C.-H. (2020, January 14–19). Leaf Spot Attention Network for Apple Leaf Disease Identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Virtual.10.1109/CVPRW50498.2020.00034 ↗
41. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
42. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4–9). Attention Is All You Need. Proceedings of the International Conference on Neural Information Processing System, Long Beach, CA, USA.
43. Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50× fewer parameters and <0.5MB model size. arXiv.
44. Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal Loss for Dense Object Detection. Proceedings of the International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
45. Ruder, S. (2016). An overview of gradient descent optimization algorithms. arXiv.
46. Csuka, G., Larlus, D., and Perronnin, F. (2013, January 9–13). What Is a Good Evaluation Measure for Semantic Segmentation?. Proceedings of the British Machine Vision Conference, Bristol, UK.10.5244/C.27.32 ↗