Vision-Guided Autonomous Robot Navigation in Realistic 3D Dynamic Scenarios
Source abstract
Abstract
This paper presents a 3D vision-based autonomous navigation system for wheeled mobile robots equipped with an RGB-D camera. The system integrates SLAM (simultaneous localization and mapping), motion planning, and obstacle avoidance to operate in both static and dynamic environments. A real-time pipeline is developed to construct sparse and dense maps for precise localization and path planning. Navigation meshes (NavMeshes) derived from 3D reconstructions facilitate efficient A* path planning. Additionally, a dynamic “U-map” generated from depth data identifies obstacles, enabling rapid NavMesh updates for obstacle avoidance. The proposed system achieves real-time performance and robust navigation across diverse terrains, including uneven surfaces and ramps, offering a comprehensive solution for 3D vision-guided robotic navigation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Robotic Path Planning Algorithms · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Mechanical Engineering, National Taiwan University, Taipei 106, Taiwan
Funding
National Science and Technology Council, Taiwan
References (32)
Show source-provided references
1. A comprehensive study for robot navigation techniques10.1080/23311916.2019.1632046 ↗
2. Ren, J., Wu, T., Zhou, X., Yang, C., Sun, J., Li, M., Jiang, H., and Zhang, A. (2022). SLAM, Path Planning Algorithm and Application Research of an Indoor Substation Wheeled Robot Navigation System. Electronics, 11.10.3390/electronics11121838 ↗
3. Tafnakaji, S., Hajieghrary, H., Teixeira, Q., and Bekiroglu, Y. (2023, January 17–20). Benchmarking local motion planners for navigation of mobile manipulators. Proceedings of the 2023 IEEE/SICE International Symposium on System Integration (SII), Atlanta, GA, USA.10.1109/SII55687.2023.10039133 ↗
4. A Comprehensive Review of Coverage Path Planning in Robotics Using Classical and Heuristic Algorithms10.1109/ACCESS.2021.3108177 ↗
5. Gao, M., Ruan, N., Shi, J., and Zhou, W. (2022). Deep Neural Network for 3D Shape Classification Based on Mesh Feature. Sensors, 22.10.3390/s22187040 ↗
6. Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters10.1109/TRO.2006.889486 ↗
7. Vision-Only Robot Navigation in a Neural Radiance World10.1109/LRA.2022.3150497 ↗
8. Zhang, G., Zhisheng, Z., Zhijie, X., Min, D., Meng, P., and Cen, J. (2022, January 16–18). Implementation and research on indoor mobile robot mapping and navigation based on RTAB-Map. Proceedings of the 2022 28th International Conference on Mechatronics and Machine Vision in Practice (M2VIP), Nanjing, China.10.1109/M2VIP55626.2022.10041090 ↗
9. A Formal Basis for the Heuristic Determination of Minimum Cost Paths10.1109/TSSC.1968.300136 ↗
10. Hazem, Z.B., Ince, R., and Dilibal, S. (October, January 29). Joint Control Implementation of 4-DOF Robotic Arm Using Robot Operating System. Proceedings of the 2022 International Conference on Theoretical and Applied Computer Science and Engineering (ICTASCE), Ankara, Turkey.10.1109/ICTACSE50438.2022.10009733 ↗
11. Carsten, J., Ferguson, D., and Stentz, A. (2006, January 9–15). 3D Field D: Improved Path Planning and Replanning in Three Dimensions. Proceedings of the 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China.10.1109/IROS.2006.282516 ↗
12. Lei, T., Sellers, T., Luo, C., Carruth, D.W., and Bi, Z. (2023). Graph-based robot optimal path planning with bio-inspired algorithms. Biomim. Intell. Robot., 3.10.1016/j.birob.2023.100119 ↗
13. Qin, H., Shao, S., Wang, T., Yu, X., Jiang, Y., and Cao, Z. (2023). Review of Autonomous Path Planning Algorithms for Mobile Robots. Drones, 7.10.3390/drones7030211 ↗
14. Fan, D., and Shi, P. (2010, January 10–12). Improvement of Dijkstra’s algorithm and its application in route planning. Proceedings of the 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery, Yantai, China.10.1109/FSKD.2010.5569452 ↗
15. LaValle, S.M., and Kuffner, J.J. (2001). Rapidly-exploring random trees: Progress and prospects: Steven m. lavalle, iowa state university, a james j. kuffner, jr., university of tokyo, tokyo, japan. Algorithmic and Computational Robotics, A K Peters/CRC Press.
16. Hsu, D., Latombe, J.-C., and Kurniawati, H. (2007). On the Probabilistic Foundations of Probabilistic Roadmap Planning. Robotics Research: Results of the 12th International Symposium ISRR, San Francisco, CA, USA, 12–15 October 2005, Springer.10.1007/978-3-540-48113-3_8 ↗
17. Pütz, S., Wiemann, T., Piening, M.K., and Hertzberg, J. (June, January 30). Continuous Shortest Path Vector Field Navigation on 3D Triangular Meshes for Mobile Robots. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China.10.1109/ICRA48506.2021.9560981 ↗
18. Vermeulen, J.L., Hillebrand, A., and Geraerts, R. (2018, January 21–25). Annotating Traversable Gaps in Walkable Environments. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.10.1109/ICRA.2018.8461152 ↗
19. Local Path Planning: Dynamic Window Approach With Virtual Manipulators Considering Dynamic Obstacles10.1109/ACCESS.2022.3150036 ↗
20. ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM10.1109/TRO.2021.3075644 ↗
21. LOAM: Lidar Odometry and Mapping in Real-time
22. Hess, W., Kohler, D., Rapp, H., and Andor, D. (2016, January 16–21). Real-Time Loop Closure in 2D LIDAR SLAM. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.10.1109/ICRA.2016.7487258 ↗
23. Bilateral Filtering: Theory and Applications
24. Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7–12). A benchmark for the evaluation of RGB-D SLAM systems. Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal.10.1109/IROS.2012.6385773 ↗
25. Zhao, Y.-L., Hong, Y.-T., and Huang, H.-P. (2024). Comprehensive Performance Evaluation between Visual SLAM and LiDAR SLAM for Mobile Robots: Theories and Experiments. Appl. Sci., 14.10.3390/app14093945 ↗
26. SurfelMeshing: Online Surfel-Based Mesh Reconstruction10.1109/TPAMI.2019.2947048 ↗
27. Volumetric Cell-and-Portal Generation10.1111/1467-8659.00677 ↗
28. Algorithms for the Reduction of the Number of Points Required to Represent a Digitized Line or Its Caricature10.3138/FM57-6770-U75U-7727 ↗
29. A Smart Sterilization Robot System with Chlorine Dioxide for Spray Disinfection10.1109/JSEN.2021.3101593 ↗
30. Oleynikova, H., Honegger, D., and Pollefeys, M. (2015, January 26–30). Reactive avoidance using embedded stereo vision for MAV flight. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.10.1109/ICRA.2015.7138979 ↗
31. Labayrade, R., Aubert, D., and Tarel, J. (2002, January 17–21). Real time obstacle detection in stereovision on non flat road geometry through “v-disparity” representation. Proceedings of the Intelligent Vehicle Symposium, 2002, IEEE, Versailles, France.
32. Wang, T.W., Huang, H.P., and Zhao, Y.L. (2024, January 15–16). Vision-based Autonomous Robot Navigation in 3D Dynamic Environments. Proceedings of the 2024 National Conference on Mechanical Engineering of CSME, Kaohsiung, Taiwan.