Deep Learning Based Detector YOLOv5 for Identifying Insect Pests
Source abstract
Abstract
Insect pests are a major element influencing agricultural production. According to the Food and Agriculture Organization (FAO), an estimated 20–40% of pest damage occurs each year, which reduces global production and becomes a major challenge to crop production. These insect pests cause sooty mold disease by sucking the sap from the crop’s organs, especially leaves, fruits, stems, and roots. To control these pests, pesticides are frequently used because they are fast-acting and scalable. Due to environmental pollution and health awareness, less use of pesticides is recommended. One of the salient approaches could be to reduce the wide use of pesticides by spraying on demand. To perform spot spraying, the location of the pest must first be determined. Therefore, the growing population and increasing food demand emphasize the development of novel methods and systems for agricultural production to address environmental concerns and ensure efficiency and sustainability. To accurately identify these insect pests at an early stage, insect pest detection and classification have recently become in high demand. Thus, this study aims to develop an object recognition system for the detection of crops damaging insect pests and their classification. The current work proposes an automatic system in the form of a smartphone IP- camera to detect insect pests from digital images/videos to reduce farmers’ reliance on pesticides. The proposed approach is based on YOLO object detection architectures including YOLOv5 (n, s, m, l, and x), YOLOv3, YOLO-Lite, and YOLOR. For this purpose, we collected 7046 images in the wild under different illumination and background conditions to train the underlying object detection approaches. We trained and test the object recognition system with different parameters from scratch. The eight models are compared and analyzed. The experimental results show that the average precision (AP@0.5) of the eight models including YOLO-Lite, YOLOv3, YOLOR, and YOLOv5 with five different scales (n, s, m, l, and x) reach 51.7%, 97.6%, 96.80%, 83.85%, 94.61%, 97.18%, 97.04%, and 98.3% respectively. The larger the model, the higher the average accuracy of the detection validation results. We observed that the YOLOv5x model is fully functional and can correctly identify the twenty-three species of insect pests at 40.5 milliseconds (ms). The developed model YOLOv5x performs the state-of-the-art model with an average precision value of (mAP@0.5) 98.3%, (mAP@0.5:0.95) value of 79.8%, precision of 94.5% and a recall of 97.8%, and F1-score with 96% on our IP-23 dataset. The results show that the system works efficiently and was able to correctly detect and identify insect pests, which can be employed for realistic application while farming.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI · Date Palm Research Studies · Mosquito-borne diseases and control
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Anhui Provincial Engineering Laboratory for Beidou Precision Agriculture Information, School of Information and Computer, Anhui Agricultural University, Hefei 230036, China
School of Information and Computer, Anhui Agricultural University, Hefei 230036, China
Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
School of Computing and Information Sciences, Caritas Institute of Higher Education Hong Kong, Hong Kong, China
Funding
Anhui Provincial Engineering Laboratory for Beidou Precision Agriculture Information Open Fund Project · 2020 Natural Science Foundation of Anhui Province · Special Fund for Anhui Characteristic Agriculture Industry Technology System (2021–2025)
References (50)
Show source-provided references
1. A global surveillance system for crop diseases10.1126/science.aaw1572 ↗
2. Boedeker, W., Watts, M., Clausing, P., and Marquez, E. (2020). The global distribution of acute unintentional pesticide poisoning: Estimations based on a systematic review. BMC Public Health, 20.10.1186/s12889-020-09939-0 ↗
3. A New Mobile Application of Agricultural Pests Recognition Using Deep Learning in Cloud Computing System10.1016/j.aej.2021.03.009 ↗
4. Application of Non-Orthogonal Multiple Access in Wireless Sensor Networks for Smart Agriculture10.1109/ACCESS.2019.2924917 ↗
5. Review of pesticide residue analysis in fruits and vegetables. Pre-treatment, extraction and detection techniques10.1016/j.foodres.2020.109141 ↗
6. Real Time Pest Detection Using YOLOv5
7. McCarthy, C., Rees, S., and Baillie, C. (2010, January 11–14). Machine Vision-Based Weed Spot Spraying: A Review and Where Next for Sugarcane. Proceedings of the 32nd Annual Conference of the Australian Society of Sugar Cane Technologists (ASSCT 2010), Bundaberg, Australia.
8. Selective spraying of grapevines for disease control using a modular agricultural robot10.1016/j.biosystemseng.2015.12.004 ↗
9. Lippi, M., Bonucci, N., Carpio, R.F., Contarini, M., Speranza, S., and Gasparri, A. (2021, January 22–25). A YOLO-Based Pest Detection System for Precision Agriculture. Proceedings of the 2021 29th Mediterranean Conference on Control and Automation (MED), Puglia, Italy.10.1109/MED51440.2021.9480344 ↗
10. Shanwad, U.K., Patil, V.C., Dasog, S.G., Mansur, C.P., and Shashidhar, K.C. (2002, January 24–25). Global Positioning System (GPS) in Precision Agriculture. Proceedings of the Asian GPS Conference, New Delhi, India.
11. Scaling Learning Algorithms towards AI
12. Deep learning analysis and age prediction from shoeprints10.1016/j.forsciint.2021.110987 ↗
13. GUV-Net for high fidelity shoeprint generation10.1007/s40747-021-00558-9 ↗
14. Soviany, P., and Ionescu, R.T. (2018, January 20–23). Optimizing the Trade-Off between Single-Stage and Two-Stage Deep Object Detectors using Image Difficulty Prediction. Proceedings of the 2018 20th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), Timisoara, Romania.10.1109/SYNASC.2018.00041 ↗
15. Murthy, C.B., Hashmi, M.F., Bokde, N.D., and Geem, Z.W. (2020). Investigations of Object Detection in Images/Videos Using Various Deep Learning Techniques and Embedded Platforms—A Comprehensive Review. Appl. Sci., 10.10.3390/app10093280 ↗
16. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
17. Wang, C.-Y., Yeh, I.-H., and Liao, H.-Y.M. (2021). You Only Learn One Representation: Unified Network for Multiple Tasks. arXiv.
18. Deep learning in agriculture: A survey10.1016/j.compag.2018.02.016 ↗
19. Nam, N.T., and Hung, P.D. (2018, January 15–18). Pest Detection on Traps Using Deep Convolutional Neural Networks. Proceedings of the 2018 International Conference on Control and Computer Vision (ICCCV ’18), Singapore.10.1145/3232651.3232661 ↗
20. Fuentes, A., Yoon, S., Kim, S.C., and Park, D.S. (2017). A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition. Sensors, 17.10.3390/s17092022 ↗
21. AF-RCNN: An anchor-free convolutional neural network for multi-categories agricultural pest detection10.1016/j.compag.2020.105522 ↗
22. Li, D., Wang, R., Xie, C., Liu, L., Zhang, J., Li, R., Wang, F., Zhou, M., and Liu, W. (2020). A Recognition Method for Rice Plant Diseases and Pests Video Detection Based on Deep Convolutional Neural Network. Sensors, 20.10.3390/s20030578 ↗
23. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single Shot Multibox Detector. Computer Vision–ECCV 2016, Springer.10.1007/978-3-319-46448-0_2 ↗
24. Zhong, Y., Gao, J., Lei, Q., and Zhou, Y. (2018). A Vision-Based Counting and Recognition System for Flying Insects in Intelligent Agriculture. Sensors, 18.10.3390/s18051489 ↗
25. Understanding of Object Detection Based on CNN Family and YOLO10.1088/1742-6596/1004/1/012029 ↗
26. A Novel Convolutional-Recurrent Hybrid Network for Sunn Pest–Damaged Wheat Grain Detection10.1007/s12161-022-02251-0 ↗
27. A CNN-SVM study based on selected deep features for grapevine leaves classification10.1016/j.measurement.2021.110425 ↗
28. Gambhir, J., Patel, N., Patil, S., Takale, P., Chougule, A., Prabhakar, C.S., Managanvi, K., Raghavan, A.S., and Sohane, R.K. (2022). Deep Learning for Real-Time Diagnosis of Pest and Diseases on Crops. Intelligent Data Engineering and Analytics, Springer.10.1007/978-981-16-6624-7_19 ↗
29. Real-time growth stage detection model for high degree of occultation using DenseNet-fused YOLOv410.1016/j.compag.2022.106694 ↗
30. Tomato detection based on modified YOLOv3 framework10.1038/s41598-021-81216-5 ↗
31. A fast accurate fine-grain object detection model based on YOLOv4 deep neural network10.1007/s00521-021-06651-x ↗
32. Tzutalin, D. (2022, August 30). GitHub. Available online: https://github.com/heartexlabs/labelImg.
33. Wang, H., Zhang, F., and Wang, L. (2020, January 11–12). Fruit Classification Model Based on Improved Darknet53 Convolutional Neural Network. Proceedings of the 2020 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS), Vientiane, Laos.10.1109/ICITBS49701.2020.00194 ↗
34. Focal Loss for Dense Object Detection10.1109/TPAMI.2018.2858826 ↗
35. Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature pyramid networks for object detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
36. The Pascal Visual Object Classes Challenge: A Retrospective10.1007/s11263-014-0733-5 ↗
37. Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Zitnick, C.L., and Dollár, P. (2015). Microsoft COCO: Common Objects in Context. arXiv, Available online: https://cocodataset.org/.10.1007/978-3-319-10602-1_48 ↗
38. Wang, C.-Y., Liao, H.-Y.M., Wu, Y.-H., Chen, P.-Y., Hsieh, J.-W., and Yeh, I.-H. (2020, January 14–19). CSPNet: A New Backbone that can Enhance Learning Capability of CNN. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.10.1109/CVPRW50498.2020.00203 ↗
39. Wang, K., Liew, J.H., Zou, Y., Zhou, D., and Feng, J. (November, January 27). PANet: Few-Shot Image Semantic Segmentation with Prototype Alignment. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00929 ↗
40. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, Faster, Stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
41. Xu, R., Lin, H., Lu, K., Cao, L., and Liu, Y. (2021). A Forest Fire Detection System Based on Ensemble Learning. Forests, 12.10.3390/f12020217 ↗
42. Nepal, U., and Eslamiat, H. (2022). Comparing YOLOv3, YOLOv4 and YOLOv5 for Autonomous Landing Spot Detection in Faulty UAVs. Sensors, 22.10.3390/s22020464 ↗
43. Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18–23). Path Aggregation Network for Instance Segmentation. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00913 ↗
44. Chen, K., Ouyang, W., Loy, C.C., Lin, D., Pang, J., Wang, J., Xiong, Y., Li, X., Sun, S., and Feng, W. (2019, January 15–20). Hybrid Task Cascade for Instance Segmentation. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00511 ↗
45. Tan, M., Pang, R., and Le, Q.V. (2020, January 13–19). EfficientDet: Scalable and Efficient Object Detection. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
46. Ruder, S. (2016). An Overview of Gradient Descent Optimization Algorithms. arXiv.
47. Stevens, E., Antiga, L., and Viehmann, T. (2020). Deep Learning with PyTorch, Manning Publications Co.
48. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8–14). PyTorch: An Imperative Style, High-Performance Deep Learning Library. Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, Vancouver, BC, Canada.
49. Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 15–20). Generalized Intersection Over union: A metric and a Loss for Bounding Box Regression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2019, Long Beach, CA, USA.10.1109/CVPR.2019.00075 ↗
50. PestNet: An End-to-End Deep Learning Approach for Large-Scale Multi-Class Pest Detection and Classification10.1109/ACCESS.2019.2909522 ↗