Detection of Camellia oleifera Fruit in Complex Scenes by Using YOLOv7 and Data Augmentation
Source abstract
Abstract
Rapid and accurate detection of Camellia oleifera fruit is beneficial to improve the picking efficiency. However, detection faces new challenges because of the complex field environment. A Camellia oleifera fruit detection method based on YOLOv7 network and multiple data augmentation was proposed to detect Camellia oleifera fruit in complex field scenes. Firstly, the images of Camellia oleifera fruit were collected in the field to establish training and test sets. Detection performance was then compared among YOLOv7, YOLOv5s, YOLOv3-spp and Faster R-CNN networks. The YOLOv7 network with the best performance was selected. A DA-YOLOv7 model was established via the YOLOv7 network combined with various data augmentation methods. The DA-YOLOv7 model had the best detection performance and a strong generalisation ability in complex scenes, with mAP, Precision, Recall, F1 score and average detection time of 96.03%, 94.76%, 95.54%, 95.15% and 0.025 s per image, respectively. Therefore, YOLOv7 combined with data augmentation can be used to detect Camellia oleifera fruit in complex scenes. This study provides a theoretical reference for the detection and harvesting of crops under complex conditions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI · Spectroscopy and Chemometric Analyses · Advanced Chemical Sensor Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Engineering, Anhui Agricultural University, Hefei 230036, China
Funding
Natural Science Foundation of Anhui Province · National Key Research and Development Program of China
References (35)
Show source-provided references
1. Design and Experiment of Shaking-branch Fruit Picking Machine for Camellia Fruit
2. Design and experiment of vibration plate type camellia fruit picking machine
3. Wu, D.L., Zhao, E.L., Fang, D., Jiang, S., Wu, C., Wang, W.W., and Wang, R.Y. (2022). Determination of Vibration Picking Parameters of Camellia oleifera Fruit Based on Acceleration and Strain Response of Branches. Agriculture, 12.10.3390/agriculture12081222 ↗
4. Optimization and Experiment of Canopy Vibration Parameters of Camellia oleifera Based on Energy Transfer Characteristics
5. Liu, J.Z., Yuan, Y., Zhou, Y., Zhu, X.X., and Syed, T.N. (2018). Experiments and Analysis of Close-Shot Identification of On-Branch Citrus Fruit with RealSense. Sensors, 18.10.3390/s18051510 ↗
6. Imperfect Wheat Grain Recognition Combined with an Attention Mechanism and Residual Network10.3390/app11115139 ↗
7. Fruit recognition from images using deep learning applications10.1007/s11042-022-12868-2 ↗
8. Automatic method of fruit object extraction under complex agricultural background for vision system of fruit picking robot10.1016/j.ijleo.2014.07.001 ↗
9. Sensors and systems for fruit detection and localization: A review10.1016/j.compag.2015.05.021 ↗
10. Deep learning—Method overview and review of use for fruit detection and yield estimation10.1016/j.compag.2019.04.017 ↗
11. Pu, J.Y., Yu, C.J., Chen, X.Y., Zhang, Y., Yang, X., and Li, J. (2022). Research on Chengdu Ma Goat Recognition Based on Computer Vison. Animals, 12.10.3390/ani12141746 ↗
12. Fruit detection for strawberry harvesting robot in non-structural environment based on Mask-RCNN10.1016/j.compag.2019.06.001 ↗
13. Apple Detection in Complex Scene Using the Improved YOLOv4 Model10.3390/agronomy11030476 ↗
14. Instance segmentation of apple flowers using the improved mask R-CNN model10.1016/j.biosystemseng.2020.03.008 ↗
15. Using YOLOv3 Algorithm with Pre- and Post-Processing for Apple Detection in Fruit-Harvesting Robot10.3390/agronomy10071016 ↗
16. Han, W., Jiang, F., and Zhu, Z.Y. (2022). Detection of Cherry Quality Using YOLOV5 Model Based on Flood Filling Algorithm. Foods, 11.10.3390/foods11081127 ↗
17. Li, S.L., Zhang, S.J., Xue, J.X., Sun, H.X., and Ren, R. (2022). A Fast Neural Network Based on Attention Mechanisms for Detecting Field Flat Jujube. Agriculture, 12.10.3390/agriculture12050717 ↗
18. Fruit Quantity and Ripeness Estimation Using a Robotic Vision System10.1109/LRA.2018.2849514 ↗
19. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
20. Real-time detection of kiwifruit flower and bud simultaneously in orchard using YOLOv4 for robotic pollination10.1016/j.compag.2021.106641 ↗
21. Yan, B., Fan, P., Lei, X.Y., Liu, Z.J., and Yang, F.Z. (2021). A Real-Time Apple Targets Detection Method for Picking Robot Based on Improved YOLOv5. Remote Sens., 13.10.3390/rs13091619 ↗
22. A real-time object detection algorithm for video10.1016/j.compeleceng.2019.05.009 ↗
23. Wang, C., Bochkovskiy, A., and Liao, H.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.10.1109/CVPR52729.2023.00721 ↗
24. Apple detection during different growth stages in orchards using the improved YOLO-V3 model10.1016/j.compag.2019.01.012 ↗
25. Zulkifley, M.A., Moubark, A.M., Saputro, A.H., and Abdani, S.R. (2022). Automated Apple Recognition System Using Semantic Segmentation Networks with Group and Shuffle Operators. Agriculture, 12.10.3390/agriculture12060756 ↗
26. Chen, L.Y., Zheng, M.C., Duan, S.Q., Luo, W.L., and Yao, L.G. (2021). Underwater Target Recognition Based on Improved YOLOv4 Neural Network. Electronics, 10.10.3390/electronics10141634 ↗
27. Li, R., and Wu, Y.P. (2022). Improved YOLOv5 Wheat Ear Detection Algorithm Based on Attention Mechanism. Electronics, 11.10.3390/electronics11111673 ↗
28. Gu, Y., Wang, S.C., Yan, Y., Tang, S.J., and Zhao, S.D. (2022). Identification and Analysis of Emergency Behavior of Cage-Reared Laying Ducks Based on YoloV5. Agriculture, 12.10.3390/agriculture12040485 ↗
29. Deep neural network based date palm tree detection in drone imagery10.1016/j.compag.2021.106560 ↗
30. Kisantal, M., Wojna, Z., Murawski, J., Naruniec, J., and Cho, K. (2019). Augmentation for small object detection. arXiv.10.5121/csit.2019.91713 ↗
31. Deep Learning Based Detector YOLOv5 for Identifying Insect Pests10.3390/app121910167 ↗
32. Ding, X.H., Zhang, X.Y., Ma, N.N., Han, J.G., Ding, G.G., and Sun, J. (2021). RepVGG: Making VGG-style ConvNets Great Again. arXiv.10.1109/CVPR46437.2021.01352 ↗
33. Ding, X.H., Hao, T.X., Tan, J.C., Liu, J., Han, J.G., Guo, Y.C., and Ding, G.G. (2021). ResRep: Lossless CNN Pruning via Decoupling Remembering. arXiv.10.1109/ICCV48922.2021.00447 ↗
34. Zheng, Z.H., Wang, P., Liu, W., Li, J.Z., Ye, R.G., and Ren, D.W. (2019). Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression. arXiv.10.1609/aaai.v34i07.6999 ↗
35. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗