Real-Time 3D Reconstruction of UAV Acquisition System for the Urban Pipe Based on RTAB-Map
Source abstract
Abstract
In urban underground projects, such as urban drainage systems, the real-time acquisition and generation of 3D models of pipes can provide an important foundation for pipe safety inspection and maintenance. The simultaneous localization and mapping (SLAM) technique, compared to the traditional structure from motion (SfM) reconstruction technique, offers high real-time performance and improves the efficiency of 3D object reconstruction. Underground pipes are situated in complex environments with unattended individuals and often lack natural lighting. To address this, this paper presents a real-time and cost-effective 3D perception and reconstruction system that utilizes an unmanned aerial vehicle (UAV) equipped with Intel RealSense D435 depth cameras and an artificial light-supplementation device. This system carries out real-time 3D reconstruction of underground pipes using the RTAB-Map (real-time appearance-based mapping) method. RTAB-Map is a graph-based visual SLAM method that combines closed-loop detection and graph optimization algorithms. The unique memory management mechanism of RTAB-Map enables synchronous mapping for multiple sessions during UAV flight. Experimental results demonstrate that the proposed system, based on RTAB-Map, exhibits the robustness, textures, and feasibility for 3D reconstruction of underground pipes.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Advanced Image and Video Retrieval Techniques · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Earth Sciences and Spatial Information Engineering, Hunan University of Sciences and Technology, Xiangtan 411201, China
Funding
China Postdoctoral Science Foundation · Hunan Provincial Natural Science Foundation
References (22)
Show source-provided references
1. Tian, T., Wang, L., Yan, X., Ruan, F., Aadityaa, G.J., Choset, H., and Li, L. (2023, October 30). Visual-Inertial-Laser-Lidar (VILL) SLAM: Real-time Dense RGB-D Mapping for Pipe Environments. Available online: https://biorobotics.ri.cmu.edu/papers/paperUploads/IROS23_2674_FI%20(1).pdf.10.1109/IROS55552.2023.10341761 ↗
2. State of the art review of inspection technologies for condition assessment of water pipes10.1016/j.measurement.2012.05.032 ↗
3. Dual-function depth camera array for inline 3D reconstruction of complex pipelines10.1016/j.autcon.2023.104893 ↗
4. Visual Simultaneous Localization and Mapping for Sewer Pipe Networks Leveraging Cylindrical Regularity10.1109/LRA.2023.3268013 ↗
5. Zhang, X., Zhao, P., Hu, Q., Wang, H., Ai, M., and Li, J. (2019). A 3D reconstruction pipeline of urban drainage pipes based on multiviewimage matching using low-cost panoramic video cameras. Water, 11.10.3390/w11102101 ↗
6. Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras10.1109/TRO.2017.2705103 ↗
7. Zou, Y., Eldemiry, A., Li, Y., and Chen, W.J.S. (2020). Robust RGB-D SLAM using point and line features for low textured scene. Sensors, 20.10.3390/s20174984 ↗
8. Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., and Rus, D. (2020–24, January 24). LIO-SAM: Tightly-coupled lidar inertial odometry via smoothing and mapping. Proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.10.1109/IROS45743.2020.9341176 ↗
9. Direct sparse odometry10.1109/TPAMI.2017.2658577 ↗
10. Qin, T., Pan, J., Cao, S., and Shen, S. (2019). A general optimization-based framework for local odometry estimation with multiple sensors. arXiv.
11. Application of RGB-D SLAM in 3D Tunnel Reconstruction Based on Superpixel Aided Feature Tracking10.5194/isprs-archives-XLIII-B2-2022-559-2022 ↗
12. Lang, R., Fan, Y., and Chang, Q. (2023). Svr-net: A sparse voxelized recurrent network for robust monocular slam with direct tsdf mapping. Sensors, 23.10.3390/s23083942 ↗
13. Labbe, M., and Michaud, F. (2014, January 14–18). Online global loop closure detection for large-scale multi-session graph-based SLAM. Proceedings of the 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.10.1109/IROS.2014.6942926 ↗
14. Distribution line pole detection and counting based on YOLO using UAV inspection line video10.1007/s42835-019-00230-w ↗
15. Vision-based autonomous navigation approach for unmanned aerial vehicle transmission-line inspection10.1177/1729881417752821 ↗
16. Ma, Y., Li, Q., Chu, L., Zhou, Y., and Xu, C. (2021). Real-time detection and spatial localization of insulators for UAV inspection based on binocular stereo vision. Remote Sens., 13.10.3390/rs13020230 ↗
17. Xiang, X., Hu, H., Ding, Y., Zheng, Y., and Wu, S.J.A.S. (2023). GC-YOLOv5s: A Lightweight Detector for UAV Road Crack Detection. Appl. Sci., 13.10.3390/app131911030 ↗
18. UAV-based pipeline inspection system with Swin Transformer for the EAST10.1016/j.fusengdes.2022.113277 ↗
19. Small unmanned airborne systems to support oil and gas pipeline monitoring and mapping10.1007/s12517-017-2989-x ↗
20. Vision-based system of AUV for an underwater pipeline tracker10.1007/s13344-012-0041-1 ↗
21. Shi, J. (1994, January 21–23). Good features to track. Proceedings of the 1994 IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.
22. Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5–11). Brief: Binary robust independent elementary features. Proceedings of the Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece.10.1007/978-3-642-15561-1_56 ↗