Data Augmentation Method for Plant Leaf Disease Recognition
Source abstract
Abstract
Recently, several plant pathogens have become more active due to temperature increases arising from climate change, which has caused damage to various crops. If climate change continues, it will likely be very difficult to maintain current crop production, and the problem of a shortage of expert manpower is also deepening. Fortunately, research on various early diagnosis systems based on deep learning is actively underway to solve these problems, but the problem of lack of diversity in some hard-to-collect disease samples remains. This imbalanced data increases the bias of machine learning models, causing overfitting problems. In this paper, we propose a data augmentation method based on an image-to-image translation model to solve the bias problem by supplementing these insufficient diseased leaf images. The proposed augmentation method performs translation between healthy and diseased leaf images and utilizes attention mechanisms to create images that reflect more evident disease textures. Through these improvements, we generated a more plausible diseased leaf image compared to existing methods and conducted an experiment to verify whether this data augmentation method could further improve the performance of a classification model for early diagnosis of plants. In the experiment, the PlantVillage dataset was used, and the extended dataset was built using the generated images and original images, and the performance of the classification models was evaluated through the test set.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, Sejong University, Seoul 05006, Republic of Korea
Department of Convergence Engineering for Intelligent Drones, Sejong University, Seoul 05006, Republic of Korea
Department of Agriculture Engineering, National Institute of Agricultural Sciences, Jeonju 63240, Republic of Korea
Funding
Korea Institute of Planning
References (43)
Show source-provided references
1. Malhi, G.S., Kaur, M., and Kaushik, P. (2021). Impact of climate change on agriculture and its mitigation strategies: A review. Sustainability, 13.10.3390/su13031318 ↗
2. Hunjan, M.S., and Lore, J.S. (2020). Crop Protection under Changing Climate, Springer.
3. Understanding yield loss and pathogen biology to improve disease management: Septoria nodorum blotch-a case study in wheat10.1094/PDIS-09-17-1375-FE ↗
4. Automatic image-based plant disease severity estimation using deep learning10.1155/2017/2917536 ↗
5. Tiwari, D., Ashish, M., Gangwar, N., Sharma, A., Patel, S., and Bhardwaj, S. (2020, January 13–15). Potato leaf diseases detection using deep learning. Proceedings of the 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India.10.1109/ICICCS48265.2020.9121067 ↗
6. Development of Efficient CNN model for Tomato crop disease identification
7. Zhao, S., Peng, Y., Liu, J., and Wu, S. (2021). Tomato leaf disease diagnosis based on improved convolution neural network by attention module. Agriculture, 11.10.3390/agriculture11070651 ↗
8. Plant disease identification from individual lesions and spots using deep learning10.1016/j.biosystemseng.2019.02.002 ↗
9. Tomato leaf disease identification by restructured deep residual dense network10.1109/ACCESS.2021.3058947 ↗
10. Using deep learning for image-based plant disease detection10.3389/fpls.2016.01419 ↗
11. Deep learning models for plant disease detection and diagnosis10.1016/j.compag.2018.01.009 ↗
12. Hassan, S.M., Jasinski, M., Leonowicz, Z., Jasinska, E., and Maji, A.K. (2021). Plant disease identification using shallow convolutional neural network. Agronomy, 11.10.3390/agronomy11122388 ↗
13. Attention-based recurrent neural network for plant disease classification10.3389/fpls.2020.601250 ↗
14. Longadge, R., and Dongre, S. (2013). Class imbalance problem in data mining review. arXiv.
15. MWMOTE--majority weighted minority oversampling technique for imbalanced data set learning10.1109/TKDE.2012.232 ↗
16. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22–29). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.244 ↗
17. Attention mechanisms in computer vision: A survey10.1007/s41095-022-0271-y ↗
18. Spatial transformer networks
19. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
20. Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., and Tang, X. (2017, January 21–26). Residual attention network for image classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.683 ↗
21. Park, J., Woo, S., Lee, J.Y., and Kweon, I.S. (2018). Bam: Bottleneck attention module. arXiv.
22. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–18). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
23. Hughes, D., and Salathé, M. (2015). An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv.
24. DCGAN-based data augmentation for tomato leaf disease identification10.1109/ACCESS.2020.2997001 ↗
25. Radford, A., Metz, L., and Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv.
26. Deng, H., Luo, D., Chang, Z., Li, H., and Yang, X. (2021). RAHC_GAN: A Data Augmentation Method for Tomato Leaf Disease Recognition. Symmetry, 13.10.3390/sym13091597 ↗
27. Cap, Q.H., Uga, H., Kagiwada, S., and Iyatomi, H. (2020). IEEE Transactions on Automation Science and Engineering, IEEE.
28. Style-Consistent Image Translation: A Novel Data Augmentation Paradigm to Improve Plant Disease Recognition10.3389/fpls.2021.773142 ↗
29. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
30. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 11–14). Identity mappings in deep residual networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46493-0_38 ↗
31. Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance normalization: The missing ingredient for fast stylization. arXiv.
32. Miyato, T., Kataoka, T., Koyama, M., and Yoshida, Y. (2018). Spectral normalization for generative adversarial networks. arXiv.
33. Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗
34. Gans trained by a two time-scale update rule converge to a local nash equilibrium
35. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
36. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
37. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
38. Tan, M., and Le, Q. (2019, January 10–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA.
39. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
40. Tomato plant disease detection using transfer learning with C-GAN synthetic images10.1016/j.compag.2021.106279 ↗
41. Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., and Aila, T. (2020, January 13–19). Analyzing and improving the image quality of stylegan. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00813 ↗
42. Choi, Y., Uh, Y., Yoo, J., and Ha, J.W. (2020, January 13–19). Stargan v2: Diverse image synthesis for multiple domains. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00821 ↗
43. Kim, J., Kim, M., Kang, H., and Lee, K. (2019). U-gat-it: Unsupervised generative attentional networks with adaptive layer-instance normalization for image-to-image translation. arXiv.