journal article·2026-03-01Open access

An integrated perception and navigation system for autonomous orchard vehicle

Yanyan Lin, Xingyu Lin, Zhengkun Cheng

AIP Advances· Volume 16· Issue 3

Abstract

Environmental perception in unstructured agricultural settings represents a fundamental challenge for autonomous orchard robotics. This study presents a real-time decision-level fusion framework integrating 32-channel LiDAR with a monocular camera for tree detection and localization in orchard environments. The perception system incorporates three key innovations: (1) triple-stage point cloud preprocessing utilizing region-of-interest segmentation, RANSAC-based ground removal, and intensity-based filtering to reduce computational load by 68%; (2) enhanced DBSCAN clustering with adaptive cluster merging and geometric shape filtering specifically optimized for tree morphology; and (3) decision-level fusion employing the Hungarian algorithm for optimal sensor association with semantic validation. A custom orchard dataset comprising 5000 annotated images was collected to train the YOLOv7 detection model, achieving 95.9% precision, 95.7% recall, and 75.2% mAP@0.5:0.95 on the test set. Experimental validation in a simulated orchard demonstrated superior performance: the fusion system achieved 97.80% precision and 96.50% recall, representing a 4.36% precision improvement over enhanced single-sensor approaches and a 29.44% gain vs baseline methods. Real-time processing capability was maintained at 41 ms per frame (24.4 FPS) with a 10-m effective perception range on moderate-cost hardware. Temporal robustness analysis across 100-frame sequences confirmed stable operation with 69% perfect detection, which is substantially higher than single-sensor methods. Field trials validated that the proposed LiDAR–camera fusion framework provides sufficient perception accuracy, robustness, and real-time performance to support practical autonomous navigation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Smart Agriculture and AI · Plant Surface Properties and Treatments · Robotics and Sensor-Based Localization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Undergraduate Education, Shenzhen Polytechnic University 1 , Shenzhen,

College of Engineering, China Agricultural University 2 , Beijing,

Funding

Shenzhen Science and Technology Program · Shenzhen Polytechnic Research Fund · Scientific Research Startup Fund for Shenzhen High-Caliber Personnel of SZPU

References (41)

Show source-provided references
1. Navigation of an autonomous spraying robot for orchard operations using LiDAR for tree trunk detection10.3390/s23104808 ↗
2. An autonomous navigation method for orchard mobile robots based on octree 3D point cloud optimization10.3389/fpls.2024.1510683 ↗
3. A survey on multi-sensor fusion based obstacle detection for intelligent ground vehicles in off-road environments10.1631/fitee.1900518 ↗
4. Multi-modal detection and mapping of static and dynamic obstacles in agriculture for process evaluation10.3389/frobt.2018.00028 ↗
5. Ambient awareness for agricultural robotic vehicles10.1016/j.biosystemseng.2015.12.010 ↗
6. DBSCAN and Yolov5 based 3D object detection and its adaptation to a mobile platform10.1016/j.mechatronics.2024.103238 ↗
7. Fish-eye-stereo calibration and epipolar rectification10.1016/j.isprsjprs.2005.03.001 ↗
8. Fruit detection, segmentation and 3D visualisation of environments in apple orchards10.1016/j.compag.2020.105302 ↗
9. Benchmark analysis of representative deep neural network architectures10.1109/access.2018.2877890 ↗
10. ROS: An open-source robot operating system
11. Multisensor data fusion: A review of the state-of-the-art10.1016/j.inffus.2011.08.001 ↗
12. Flexible camera calibration by viewing a plane from unknown orientations
13. 2003
14. Camera calibration with one-dimensional objects10.1109/TPAMI.2004.21 ↗
15. Close-range camera calibration
16. Using YOLOv3 algorithm with pre-and post-processing for apple detection in fruit-harvesting robot10.3390/agronomy10071016 ↗
17. General hand–eye calibration based on reprojection error minimization10.1109/lra.2019.2893612 ↗
18. Long-term 3D map maintenance in dynamic environments
19. A minimal solution for the extrinsic calibration of a camera and a laser-rangefinder10.1109/tpami.2012.18 ↗
20. R. Unnikrishnan and M.Hebert, “Fast extrinsic calibration of a laser rangefinder to a camera,” Tech. Rep. CMU-RI-TR-05-09, Robotics Institute, Pittsburgh, PA, 2005.
21. Are we ready for autonomous driving? The KITTI vision benchmark suite
22. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography10.1145/358669.358692 ↗
23. Calibration between color camera and 3D LIDAR instruments with a polygonal planar board10.3390/s140305333 ↗
24. 1 year, 1000 km: The Oxford RobotCar dataset10.1177/0278364916679498 ↗
25. A joint extrinsic calibration tool for radar, camera and lidar10.1109/tiv.2021.3065208 ↗
26. I. Loshchilov and F.Hutter, “SGDR: Stochastic gradient descent with warm restarts,” arXiv:1608.03983 (2016).
27. A. Bochkovskiy , C.-Y.Wang, and H.-Y. M.Liao, “YOLOv4: Optimal speed and accuracy of object detection,” arXiv:2004.10934 (2020).
28. Comparing terrestrial laser scanning (TLS) and wearable laser scanning (WLS) for individual tree modeling at plot level10.3390/rs10040540 ↗
29. Mean shift: A robust approach toward feature space analysis10.1109/34.1000236 ↗
30. 3D is here: Point cloud library (PCL)
31. A density-based algorithm for discovering clusters in large spatial databases with noise
32. Agricultural robotics: Unmanned robotic service units in agricultural tasks10.1109/mie.2013.2252957 ↗
33. Vision-based obstacle detection and navigation for an agricultural robot10.1002/rob.21644 ↗
34. Harvesting robots for high-value crops: State-of-the-art review and challenges ahead10.1002/rob.21525 ↗
35. Vision and 2D LiDAR fusion-based navigation line extraction for autonomous agricultural robots in dense pomegranate orchards10.3390/s25175432 ↗
36. Real-time localization and colorful three-dimensional mapping of orchards based on multi-sensor fusion using extended Kalman filter10.3390/agronomy13082158 ↗
37. A camera-LiDAR-IMU fusion method for real-time extraction of navigation line between maize field rows10.1016/j.compag.2024.109114 ↗
38. An improved DBSCAN method for LiDAR data segmentation with automatic Eps estimation10.3390/s19010172 ↗
39. Density-based clustering for 3D object detection in point clouds
40. Advanced point cloud techniques for improved 3D object detection: A Study on DBSCAN, attention, and downsampling10.3390/wevj15110527 ↗
41. A novel end-to-end vision-based architecture for agricultural human–robot collaboration in fruit picking operations10.1016/j.robot.2023.104567 ↗