Navigation Map Construction Based on Semantic Segmentation and Multi-Submap Integration
Source abstract
Abstract
Traditional visual simultaneous localization and mapping (SLAM) systems typically generate sparse or semi-dense point cloud maps, which are insufficient for effective navigation and path planning. Constructing navigation maps through dense depth estimation generally entails high computational costs, and depth estimation is prone to errors in weakly textured regions such as road surfaces. Furthermore, traditional visual SLAM methods rely on local relative coordinate systems, making it extremely challenging to merge mapping results from different coordinate frames in navigation systems lacking global positioning constraints. To address these limitations, this paper presents a multi-submap fusion mapping method based on semantic ground fitting and incorporates global navigation satellite system (GNSS) to provide global positioning information via occupancy grid maps. The method emphasizes the integration of low-cost sensors into a unified system, aiming to create an accurate and real-time mapping solution that is cost-effective and highly applicable. Simultaneously, a multi-submap management mechanism is introduced to dynamically store and load maps, updating only the submaps surrounding the vehicle. This ensures real-time map updates while minimizing computational and storage resource consumption. Extensive testing of the proposed method in real-world scenarios, using a self-built experimental platform, demonstrates that the generated grid map meets the accuracy requirements for navigation tasks.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Geographic Information Systems Studies · Robotic Path Planning Algorithms
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Electrical Engineering, Guangxi University, Nanning 530004, China
Funding
National Natural Science Foundation of China · Natural Science Foundation of Guangxi
References (37)
Show source-provided references
1. Viswanathan, D.G. (2009, January 6–8). Features from accelerated segment test (fast). Proceedings of the 10th Workshop on Image Analysis for Multimedia Interactive Services, London, UK.
2. Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5–11). Brief: Binary robust independent elementary features. Proceedings of the Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Greece.10.1007/978-3-642-15561-1_56 ↗
3. ORB-SLAM: A versatile and accurate monocular SLAM system10.1109/TRO.2015.2463671 ↗
4. Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras10.1109/TRO.2017.2705103 ↗
5. Orb-slam3: An accurate open-source library for visual, visual–inertial, and multimap slam10.1109/TRO.2021.3075644 ↗
6. A review of visual SLAM methods for autonomous driving vehicles10.1016/j.engappai.2022.104992 ↗
7. Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohi, P., Shotton, J., Hodges, S., and Fitzgibbon, A. (2011, January 26–29). Kinectfusion: Real-time dense surface mapping and tracking. Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzeraland.10.1109/ISMAR.2011.6162880 ↗
8. McCormac, J., Handa, A., Davison, A., and Leutenegger, S. (June, January 29). Semanticfusion: Dense 3d semantic mapping with convolutional neural networks. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.10.1109/ICRA.2017.7989538 ↗
9. Runz, M., Buffier, M., and Agapito, L. (2018, January 16–20). Maskfusion: Real-time recognition, tracking and reconstruction of multiple moving objects. Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, Germany.10.1109/ISMAR.2018.00024 ↗
10. Tosi, F., Bartolomei, L., and Poggi, M. (2025). A survey on deep stereo matching in the twenties. Int. J. Comput. Vis., 1–32.10.1007/s11263-024-02331-0 ↗
11. Li, Y., Zhao, H., Qi, X., Wang, L., Li, Z., Sun, J., and Jia, J. (2021, January 20–25). Fully convolutional networks for panoptic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00028 ↗
12. Deep learning for monocular depth estimation: A review10.1016/j.neucom.2020.12.089 ↗
13. Liu, C.W., Wang, H., Guo, S., Bocus, M.J., Chen, Q., and Fan, R. (2023). Stereo matching: Fundamentals, state-of-the-art, and existing challenges. Autonomous Driving Perception: Fundamentals and Applications, Springer.10.1007/978-981-99-4287-9_3 ↗
14. Single image depth estimation: An overview10.1016/j.dsp.2022.103441 ↗
15. A review of global path planning methods for occupancy grid maps regardless of obstacle density10.1007/s10846-016-0362-z ↗
16. Sift-the scale invariant feature transform
17. Bay, H., Tuytelaars, T., and Van Gool, L. (2006). Surf: Speeded up robust features. Proceedings of the Computer Vision–ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, 7–13 May 2006, Springer. Proceedings, Part I 9.
18. Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6–13). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126544 ↗
19. Bags of binary words for fast place recognition in image sequences10.1109/TRO.2012.2197158 ↗
20. GVINS: Tightly coupled GNSS–visual–inertial fusion for smooth and consistent state estimation10.1109/TRO.2021.3133730 ↗
21. Vins-mono: A robust and versatile monocular visual-inertial state estimator10.1109/TRO.2018.2853729 ↗
22. G-VIDO: A vehicle dynamics and intermittent GNSS-aided visual-inertial state estimator for autonomous driving10.1109/TITS.2021.3107873 ↗
23. Liu, J., Gao, W., and Hu, Z. (June, January 30). Optimization-based visual-inertial SLAM tightly coupled with raw GNSS measurements. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China.10.1109/ICRA48506.2021.9562013 ↗
24. Improved Multi-sensor Fusion Positioning System Based on GNSS/LiDAR/Vision/IMU with Semi-tightly Coupling and Graph Optimization in GNSS Challenging Environments10.1109/ACCESS.2023.3311359 ↗
25. An occupancy grid mapping enhanced visual SLAM for real-time locating applications in indoor GPS-denied environments10.1016/j.autcon.2019.04.011 ↗
26. Chang, Q., Li, X., Xu, X., Liu, X., Li, Y., and Miyazaki, J. (June, January 29). StereoVAE: A lightweight stereo-matching system using embedded GPUs. Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK.10.1109/ICRA48891.2023.10160441 ↗
27. Li, J., Wang, P., Xiong, P., Cai, T., Yan, Z., Yang, L., Liu, J., Fan, H., and Liu, S. (2022, January 18–24). Practical stereo matching via cascaded recurrent network with adaptive correlation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01578 ↗
28. Xu, G., Wang, X., Ding, X., and Yang, X. (2023, January 17–24). Iterative geometry encoding volume for stereo matching. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.02099 ↗
29. Real-time stereo matching with high accuracy via Spatial Attention-Guided Upsampling10.1007/s10489-023-04646-w ↗
30. Kümmerle, R., Grisetti, G., Strasdat, H., Konolige, K., and Burgard, W. (2011, January 9–13). g 2 o: A general framework for graph optimization. Proceedings of the 2011 IEEE international Conference on Robotics and Automation, Shanghai, China.
31. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses10.1109/JRA.1987.1087109 ↗
32. Research on construction Theory of Global cGcs2000 coordinate Frame
33. Integrated lateral control for 4WID/4WIS vehicle in high-speed condition considering the magnitude of steering10.1080/00423114.2019.1645343 ↗
34. Weinzaepfel, P., Lucas, T., Leroy, V., Cabon, Y., Arora, V., Brégier, R., Csurka, G., Antsfeld, L., Chidlovskii, B., and Revaud, J. (2023, January 2–6). Croco v2: Improved cross-view completion pre-training for stereo matching and optical flow. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01647 ↗
35. Xu, G., Cheng, J., Guo, P., and Yang, X. (2022, January 18–24). Attention concatenation volume for accurate and efficient stereo matching. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01264 ↗
36. Zeng, J., Yao, C., Yu, L., Wu, Y., and Jia, Y. (2023, January 2–6). Parameterized cost volume for stereo matching. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01682 ↗
37. A hybrid path planning algorithm considering AUV dynamic constraints based on improved A* algorithm and APF algorithm10.1016/j.oceaneng.2023.115333 ↗