journal article·2024-07-12Open access

Unmanned Aerial Vehicle Landing on Rugged Terrain by On-Board LIDAR–Camera Positioning System

Cheng Zou, Yezhen Sun, Linghua Kong

Applied Sciences· Volume 14· Issue 14

Abstract

Safely landing unmanned aerial vehicles (UAVs) in unknown environments that are denied by GPS is challenging but crucial. In most cases, traditional landing methods are not suitable, especially under complex terrain conditions with insufficient map information. This report proposes an innovative multi-stage UAV landing framework involving (i) point cloud and image fusion positioning, (ii) terrain analysis, and (iii) neural network semantic recognition to optimize landing site selection. In the first step, 3D point cloud and image data are fused to attain a comprehensive perception of the environment. In the second step, an energy cost function considering texture and flatness is employed to identify potential landing sites based on energy scores. To navigate the complexities of classification for precise landings, the results are stratified by the difficulty of various UAV landing scenarios. In the third step, a network model is applied to analyze UAV landing site options by integrating the ResNet50 network with a convolutional block attention module. Experimental results indicate a reduction in computational load and improved landing site identification accuracy. The developed framework fuses multi-modal data to enhance the safety and feasibility of UAV landings in complex environments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · Robotic Path Planning Algorithms · UAV Applications and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Fujian Key Laboratory of Intelligent Machining Technology and Equipment, Fujian University of Technology, Fuzhou 350100, China

Funding

Fujian Natural Science Foundation Project · Scientific Research Start Foundation of Fujian University of Technology

References (50)

Show source-provided references
1. Navia, J., Mondragon, I., Patino, D., and Colorado, J. (2016, January 7–10). Multispectral mapping in agriculture: Terrain mosaic using an autonomous quadcopter UAV. Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, VA, USA.10.1109/ICUAS.2016.7502606 ↗
2. UAV-based stereo vision for rapid aerial terrain mapping10.2747/1548-1603.48.1.24 ↗
3. Toward a fully autonomous UAV: Research platform for indoor and outdoor urban search and rescue10.1109/MRA.2012.2206473 ↗
4. Nikolic, J., Burri, M., Rehder, J., Leutenegger, S., Huerzeler, C., and Siegwart, R. (2013, January 2–9). A UAV system for inspection of industrial facilities. Proceedings of the 2013 IEEE Aerospace Conference, Big Sky, MT, USA.10.1109/AERO.2013.6496959 ↗
5. Covert spoofing algorithm of UAV based on GPS/INS-integrated navigation10.1109/TVT.2019.2914477 ↗
6. New optimal smoothing scheme for improving relative and absolute accuracy of tightly coupled GNSS/SINS integration10.1007/s10291-017-0601-1 ↗
7. Coastal erosion and mass wasting along the Canadian Beaufort Sea based on annual airborne LiDAR elevation data10.1016/j.geomorph.2016.02.014 ↗
8. Lin, Y.C., Cheng, Y.T., Zhou, T., Ravi, R., Hasheminasab, S.M., Flatt, J.E., Troy, C., and Habib, A. (2019). Evaluation of UAV LiDAR for mapping coastal environments. Remote Sens., 11.10.3390/rs11242893 ↗
9. An integrated UAV-borne lidar system for 3D habitat mapping in three forest ecosystems across China10.1080/01431161.2017.1285083 ↗
10. Suzuki, T., Inoue, D., and Amano, Y. (2019, January 3–8). Robust UAV Position and Attitude Estimation using Multiple GNSS Receivers for Laser-based 3D Mapping. Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.10.1109/IROS40897.2019.8967894 ↗
11. Guo, Y., Guo, J., Liu, C., Xiong, H., Chai, L., and He, D. (2020). Precision Landing Test and Simulation of the Agricultural UAV on Apron. Sensors, 20.10.3390/s20123369 ↗
12. Vidal, V., Honório, L., Santos, M., Silva, M., Cerqueira, A., and Oliveira, E. (2017, January 28–31). UAV vision aided positioning system for location and landing. Proceedings of the 2017 18th International Carpathian Control Conference (ICCC), Sinaia, Romania.10.1109/CarpathianCC.2017.7970402 ↗
13. Autonomous vision-based target detection and safe landing for UAV10.1007/s12555-018-0017-x ↗
14. Free LSD: Prior-free visual landing site detection for autonomous planes10.1109/LRA.2018.2809962 ↗
15. Forster, C., Faessler, M., Fontana, F., Werlberger, M., and Scaramuzza, D. (2015, January 26–30). Continuous on-board monocular-vision-based elevation mapping applied to autonomous landing of micro aerial vehicles. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.10.1109/ICRA.2015.7138988 ↗
16. Miller, A., Miller, B., Popov, A., and Stepanyan, K. (2019). UAV landing based on the optical flow videonavigation. Sensors, 19.10.3390/s19061351 ↗
17. Cheng, H.W., Chen, T.L., and Tien, C.H. (2019). Motion estimation by hybrid optical flow technology for UAV landing in an unvisited area. Sensors, 19.10.3390/s19061380 ↗
18. Zheng, W., Yi, J., Xiang, H., Zhou, B., Wang, D., and Zhao, C. (2021, January 28–30). A Study for UAV Autonomous Safe Landing-Site Selection on Rough Terrain. Proceedings of the The 2nd International Conference on Computing and Data Science, Stanford, CA, USA.10.1145/3448734.3450884 ↗
19. Autonomous UAVs landing site selection from point cloud in unknown environments10.1016/j.isatra.2022.04.005 ↗
20. Loureiro, G., Dias, A., Martins, A., and Almeida, J. (2021). Emergency landing spot detection algorithm for unmanned aerial vehicles. Remote Sens., 13.10.3390/rs13101930 ↗
21. Singh, J., Adwani, N., Kandath, H., and Krishna, K.M. (2023, January 6–9). RHFSafeUAV: Real-Time Heuristic Framework for Safe Landing of UAVs in Dynamic Scenarios. Proceedings of the 2023 International Conference on Unmanned Aircraft Systems (ICUAS), Warsaw, Poland.10.1109/ICUAS57906.2023.10156604 ↗
22. An automatic zone detection system for safe landing of UAVs10.1016/j.eswa.2019.01.024 ↗
23. Guérin, J., Delmas, K., and Guiochet, J. (2021, January 21–24). Certifying emergency landing for safe urban uav. Proceedings of the 2021 51st Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W), Taipei, Taiwan.10.1109/DSN-W52860.2021.00020 ↗
24. Semantic segmentation based mapping systems for the safe and precise landing of flying vehicles10.1016/j.ifacol.2023.03.052 ↗
25. Liu, F., Shan, J., Xiong, B., and Fang, Z. (2022). A real-time and multi-sensor-based landing area recognition system for uavs. Drones, 6.10.3390/drones6050118 ↗
26. A survey of safe landing zone detection techniques for autonomous unmanned aerial vehicles (UAVs)10.1016/j.eswa.2021.115091 ↗
27. Yan, L., Qi, J., Wang, M., Wu, C., and Xin, J. (2020, January 27–29). A safe landing site selection method of UAVs based on LiDAR point clouds. Proceedings of the 2020 39th Chinese Control Conference (CCC), Shenyang, China.10.23919/CCC50068.2020.9189499 ↗
28. Real-time collision-free landing path planning for drone deliveries in urban environments10.4218/etrij.2023-0129 ↗
29. An auto-landing strategy based on pan-tilt based visual servoing for unmanned aerial vehicle in GNSS-denied environments10.1016/j.ast.2021.106891 ↗
30. Autonomous landing scene recognition based on transfer learning for drones10.23919/JSEE.2023.000031 ↗
31. On the visual-based safe landing of UAVs in populated areas: A crucial aspect for urban deployment10.1109/LRA.2021.3101861 ↗
32. Shen, K., Zhuang, Y., and Zhu, Y. (2020, January 27–29). Incremental learning-based land mark recognition for mirco-UAV autonomous landing. Proceedings of the 2020 39th Chinese Control Conference (CCC), Shenyang, China.10.23919/CCC50068.2020.9188835 ↗
33. Kim, C., Lee, E.M., Choi, J., Jeon, J., Kim, S., and Myung, H. (2021, January 12–15). ROLAND: Robust landing of UAV on moving platform using object detection and UWB based extended kalman filter. Proceedings of the 2021 21st International Conference on Control, Automation and Systems (ICCAS), Jeju, Republic of Korea.10.23919/ICCAS52745.2021.9649920 ↗
34. Adaptive Tracking and Perching for Quadrotor in Dynamic Scenarios10.1109/TRO.2023.3335670 ↗
35. Ioannou, Y., Taati, B., Harrap, R., and Greenspan, M. (2012, January 13–15). Difference of normals as a multi-scale operator in unorganized point clouds. Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, Zurich, Switzerland.10.1109/3DIMPVT.2012.12 ↗
36. A flexible new technique for camera calibration10.1109/34.888718 ↗
37. Moré, J.J. (1978). The Levenberg-Marquardt algorithm: Implementation and theory. Numerical Analysis, Springer.10.1007/BFb0067700 ↗
38. RTAB-Map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation10.1002/rob.21831 ↗
39. Zhang, J., and Singh, S. (2014, January 12–16). LOAM: Lidar Odometry and Mapping in Real-time. Proceedings of the Robotics: Science and Systems, Berkeley, CA, USA.10.15607/RSS.2014.X.007 ↗
40. Lin, J., and Zhang, F. (August, January 31). Loam livox: A fast, robust, high-precision LiDAR odometry and mapping package for LiDARs of small FoV. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.10.1109/ICRA40945.2020.9197440 ↗
41. An accelerated image matching technique for UAV orthoimage registration10.1016/j.isprsjprs.2017.03.017 ↗
42. AID: A benchmark data set for performance evaluation of aerial scene classification10.1109/TGRS.2017.2685945 ↗
43. Yang, Y., and Newsam, S. (2010, January 2–5). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, San Jose, CA, USA.10.1145/1869790.1869829 ↗
44. Places: A 10 million image database for scene recognition10.1109/TPAMI.2017.2723009 ↗
45. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
46. Gao, J., Zhang, B., Wu, Y., and Guo, C. (2022, January 25–27). Building Extraction from High Resolution Remote Sensing Images Based on Improved Mask R-CNN. Proceedings of the 2022 4th International Conference on Robotics and Computer Vision (ICRCV), Wuhan, China.10.1109/ICRCV55858.2022.9953243 ↗
47. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
48. Partial domain adaptation for scene classification from remote sensing imagery10.1109/TGRS.2023.3336665 ↗
49. Multiobjective ResNet pruning by means of EMOAs for remote sensing scene classification10.1016/j.neucom.2019.11.097 ↗
50. Katigbak, C.N.R., Garcia, J.R.B., Gutang, J.E.D., De Villa, J.B., Alcid, A.D.C., Vicerra, R.R.P., Cruz, A.R.D., Roxas, E.A., and Serrano, K.K.D. (2015, January 9–12). Autonomous trajectory tracking of a quadrotor UAV using PID controller. Proceedings of the 2015 International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM), Cebu, Philippines.10.1109/HNICEM.2015.7393247 ↗