Approach of Dynamic Tracking and Counting for Obscured Citrus in Smart Orchard Based on Machine Vision
Source abstract
Abstract
The approach of dynamic tracking and counting for obscured citrus based on machine vision is a key element to realizing orchard yield measurement and smart orchard production management. In this study, focusing on citrus images and dynamic videos in a modern planting mode, we proposed the citrus detection and dynamic counting method based on the lightweight target detection network YOLOv7-tiny, Kalman filter tracking, and the Hungarian algorithm. The YOLOv7-tiny model was used to detect the citrus in the video, and the Kalman filter algorithm was used for the predictive tracking of the detected fruits. In order to realize optimal matching, the Hungarian algorithm was improved in terms of Euclidean distance and overlap matching and the two stages life filter was added; finally, the drawing lines counting strategy was proposed. ln this study, the detection performance, tracking performance, and counting effect of the algorithms are tested respectively; the results showed that the average detection accuracy of the YOLOv7-tiny model reached 97.23%, the detection accuracy in orchard dynamic detection reached 95.12%, the multi-target tracking accuracy and the precision of the improved dynamic counting algorithm reached 67.14% and 74.65% respectively, which were higher than those of the pre-improvement algorithm, and the average counting accuracy of the improved algorithm reached 81.02%. The method was proposed to effectively help fruit farmers grasp the number of citruses and provide a technical reference for the study of yield measurement in modernized citrus orchards and a scientific decision-making basis for the intelligent management of orchards.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Engineering, China Agricultural University, Beijing 100083, China
Institute of Urban Agriculture, Chinese Academy of Agriculture Sciences, Chengdu 610213, China
Institute of Agricultural Resources and Regional Planning, Chinese Academy of Agricultural Sciences, Beijing 100081, China
College of Mechanical and Electrical Engineering, Shandong Agricultural University, Taian 271018, China
Funding
Institute of Urban Agriculture, Chinese Academy of Agriculture Sciences · key projects of the Sichuan Provincial Science and Technology Plan · Chengdu Local Finance Special Fund Project for NASC
References (28)
Show source-provided references
1. Citrus Fruit Recognition and Counting Study Based on Improved YOLOv5+DeepSort
2. A Study on China’s Citrus Export Growth Based on Ternary Marginal Analysis
3. Research progress of citrus on-tree storage
4. Mekhalfi, M.L., Nicolò, C., Ianniello, I., Calamita, F., Goller, R., Barazzuol, M., and Melgani, F. (2020). Vision System for Automatic On-Tree Kiwifruit Counting and Yield Estimation. Sensors, 20.10.3390/s20154214 ↗
5. Deep learning for real-time fruit detection and orchard fruit load estimation: Benchmarking of ‘MangoYOLO’10.1007/s11119-019-09642-0 ↗
6. A study on tree citrus recognition based on color information
7. Segmentation of Yangmei images based on homomorphic filtering and K-means clustering algorithm
8. A segmentation method of bagged green apple image10.1016/j.scienta.2018.11.030 ↗
9. Research and Improvement of Fruits Detection Based on Deep Learning
10. Research Progress on Vision System and Manipulator of Fruit Picking Robot
11. Recognition of Rosa roxbunghii in natural environment based on improved Faster RCNN
12. Orange recognition method using improved YOLOv3-LITE lightweight neural network
13. Discriminative Correlation Filter Tracker with Channel and Spatial Reliability10.1007/s11263-017-1061-3 ↗
14. Apple detection and counting using real-time video based on deep learning and object tracking
15. Bagged grape yield estimation method using a self-correcting NMS-ByteTrack
16. FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking10.1007/s11263-021-01513-4 ↗
17. A lightweight fruit load estimation model for edge computing equipment
18. Nicolai, W., Alex, B., and Dietrich, P. (2017, January 17–20). Simple Online and Realtime Tracking with a Deep Association Metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.
19. Anton, M., Leal-Taixe, L., Reid, I., Roth, S., and Schindler, K. (2016). MOT16: A Benchmark for Multi-Object Tracking, Cornell University Library.
20. Chien-Yao, W., Bochkovskiy, A., and Hong-Yuan, M.L. (2022). YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors, Cornell University Library.
21. Jiang, T., Zhao, J., and Wang, M. (2023). Bird Detection on Power Transmission Lines Based on Improved YOLOv7. Appl. Sci., 13.10.3390/app132111940 ↗
22. Xie, T., and Yao, X. (2023). Smart Logistics Warehouse Moving-Object Tracking Based on YOLOv5 and DeepSORT. Appl. Sci., 13.10.3390/app13179895 ↗
23. Li, Z., Yang, X., Li, L., and Chen, H. (2024). Iterated Orthogonal Simplex Cubature Kalman Filter and Its Applications in Target Tracking. Appl. Sci., 14.10.3390/app14010392 ↗
24. Kalman Filtering with Intermittent Observations10.1109/TAC.2004.834121 ↗
25. Mills-Tettey, G.A., Stentz, A., and Dias, M.B. (2007). The Dynamic Hungarian Algorithm for the Assignment Problem with Changing Costs, Robotics Institute.
26. Research on yield prediction of single mature citrus tree based on image recognition
27. Detecting and counting of spring-see citrus using YOLOv4 network model and recursive fusion of features
28. Fast Detection and Yield Estimation of Ripe Citrus Fruit Based on Machine Vision