YSAG-VINS—A Robust Visual-Inertial Navigation System with Adaptive Geometric Constraints and Semantic Information Based on YOLOv8n-ODUIB in Dynamic Environments
Source abstract
Abstract
Dynamic environments pose significant challenges for Visual Simultaneous Localization and Mapping (VSLAM), as moving objects can introduce outlier observations that severely degrade localization and mapping performance. To address this problem, we propose YSAG-VINS, a VSLAM algorithm specifically designed for dynamic scenes. The system integrates an enhanced YOLOv8 object detection network with an adaptive epipolar constraint strategy to effectively identify and suppress the impact of dynamic features. In particular, a lightweight YOLOv8n model augmented with ODConv and UIB modules is employed to balance detection accuracy with real-time efficiency. Based on semantic detection results, images are divided into static background and potentially dynamic regions, and the motion state of these regions is further verified using geometric constraints. Features belonging to truly dynamic objects are then removed to enhance robustness. Comprehensive experiments on multiple public datasets demonstrate that YSAG-VINS achieves superior pose estimation accuracy compared with VINS-Fusion, VDO-SLAM, and Dynamic-VINS. On three dynamic sequences of the KITTI dataset, the proposed method achieves average RMSE improvement rates of 48.62%, 12.18%, and 13.50%, respectively. These results confirm that YSAG-VINS provides robust and high-accuracy localization performance in dynamic environments, making it a promising solution for real-world applications such as autonomous driving, service robotics, and augmented reality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Inertial Sensor and Navigation · Satellite Image Processing and Photogrammetry
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Surveying and Geo-Informatics, Shandong Jianzhu University, Jinan 250101, China
School of Transportation Engineering, Shandong Jianzhu University, Jinan 250101, China
College of Ocean Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China
Funding
Natural Science Foundation of Shandong Province · National Natural Science Foundation of China
References (38)
Show source-provided references
1. Simultaneous localization and mapping: Part I10.1109/MRA.2006.1678144 ↗
2. Klein, G., and Murray, D. (2007, January 13–16). Parallel tracking and mapping for small AR workspaces. Proceedings of the 6th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR), Nara, Japan.10.1109/ISMAR.2007.4538852 ↗
3. ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras10.1109/TRO.2017.2705103 ↗
4. Forster, C., Pizzoli, M., and Scaramuzza, D. (June, January 13). SVO: Fast semi-direct monocular visual odometry. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.
5. Rosinol, A., Abate, M., Chang, Y., and Carlone, L. (August, January 31). Kimera: An open-source library for real-time metric-semantic localization and mapping. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Paris, France.
6. VINS-Mono: A robust and versatile monocular visual-inertial state estimator10.1109/TRO.2018.2853729 ↗
7. Engel, J., Schöps, T., and Cremers, D. (2014, January 8–11). LSD-SLAM: Large-scale direct monocular SLAM. Proceedings of the European Conference on Computer Vision (ECCV), Cham, Switzerland.10.1007/978-3-319-10605-2_54 ↗
8. OVD-SLAM: An online visual SLAM for dynamic environments10.1109/JSEN.2023.3270534 ↗
9. Dynamic SLAM: A visual SLAM in outdoor dynamic scenes
10. YOLO-SLAM: A semantic SLAM system towards dynamic environment with geometric constraint10.1007/s00521-021-06764-3 ↗
11. Guan, H., Qian, C., Wu, T., Hu, X., Duan, F., and Ye, X. (2023). A dynamic scene vision SLAM method incorporating object detection and object characterization. Sustainability, 15.10.3390/su15043048 ↗
12. ORB-SLAM: A versatile and accurate monocular SLAM system10.1109/TRO.2015.2463671 ↗
13. Kerl, C., Sturm, J., and Cremers, D. (2013, January 3–8). Dense visual SLAM for RGB-D cameras. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan.10.1109/IROS.2013.6696650 ↗
14. Alcantarilla, P.F., Yebes, J.J., Almazán, J., and Bergasa, L.M. (2012, January 14–18). On combining visual SLAM and dense scene flow to increase the robustness of localization and mapping in dynamic environments. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Saint Paul, MN, USA.10.1109/ICRA.2012.6224690 ↗
15. Tan, W., Liu, H., Dong, Z., Zhang, G., and Bao, H. (2013, January 1–4). Robust Monocular SLAM in dynamic environments. Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR), Adelaide, Australia.
16. Wang, Y., and Huang, S. (2014, January 10–12). Towards dense moving object segmentation based robust dense RGB-D SLAM in dynamic scenarios. Proceedings of the International Conference on Control, Automation, Robotics and Vision (ICARCV), Singapore.10.1109/ICARCV.2014.7064596 ↗
17. DynaSLAM: Tracking, mapping, and inpainting in dynamic scenes10.1109/LRA.2018.2860039 ↗
18. Runz, M., Buffier, M., and Agapito, L. (2018, January 16–20). MaskFusion: Real-time recognition, tracking and reconstruction of multiple moving objects. Proceedings of the 6th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, Germany.10.1109/ISMAR.2018.00024 ↗
19. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
20. A real-time dynamic object segmentation framework for SLAM system in dynamic scenes
21. Bolya, D., Zhou, C., Xiao, F., and Lee, Y.J. (2019, January 27–28). YOLACT: Real-time instance segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, South Korea.10.1109/ICCV.2019.00925 ↗
22. Zhang, J., Henein, M., Mahony, R., and Ila, V. (2020). VDO-SLAM: A visual dynamic object-aware SLAM system. arXiv.
23. Zhang, C., Huang, T., Zhang, R., and Yi, X. (2021). PLD-SLAM: A new RGB-D SLAM method with point and line features for indoor dynamic scene. ISPRS Int. J. Geo-Inf., 10.10.3390/ijgi10030163 ↗
24. DE-SLAM: SLAM for highly dynamic environment10.1002/rob.22062 ↗
25. Yang, J., Wang, Y., Tan, X., Fang, M., and Ma, L. (2025). DHP-SLAM: A real-time visual SLAM system with high positioning accuracy under dynamic environment. Displays, 84.10.1016/j.displa.2025.103067 ↗
26. SG-SLAM: A real-time RGB-D visual SLAM toward dynamic scenes with semantic and geometric information10.1109/TIM.2023.3326234 ↗
27. DynaVINS: A visual-inertial SLAM for dynamic environments10.1109/LRA.2022.3203231 ↗
28. COEB-SLAM: A robust VSLAM in dynamic environments combined object detection, epipolar geometry constraint, and blur filtering10.1109/JSEN.2023.3317056 ↗
29. Sun, H., Fan, Q., Zhang, H., and Liu, J. (2024). A real-time visual SLAM based on semantic information and geometric information in dynamic environment. J. Real-Time Image Process., 21.10.1007/s11554-024-01527-4 ↗
30. Zhu, Y., Cheng, P., Zhuang, J., Wang, Z., and He, T. (2024). Visual simultaneous localization and mapping optimization method based on object detection in dynamic scene. Appl. Sci., 14.10.3390/app14051787 ↗
31. Li, C., Zhou, A., and Yao, A. (2022). Omni-dimensional dynamic convolution. arXiv.
32. Qin, D., Leichner, C., Delakis, M., Fornoni, M., Luo, S., Yang, F., Wang, W., Banbury, C., Ye, C., and Akin, B. (October, January 29). MobileNetV4: Universal models for the mobile ecosystem. Proceedings of the European Conference on Computer Vision (ECCV), Cham, Switzerland.
33. Xu, G. (1996). Epipolar Geometry in Stereo, Motion and Object Recognition, Springer. Computational Imaging and Vision.10.1007/978-94-015-8668-9 ↗
34. Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., and Darrell, T. (2020, January 18–24). BDD100K: A diverse driving dataset for heterogeneous multitask learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00271 ↗
35. Vision meets robotics: The KITTI dataset10.1177/0278364913491297 ↗
36. M2DGR: A multi-sensor and multi-scenario SLAM dataset for ground robots10.1109/LRA.2021.3138527 ↗
37. Jia, Y., Wang, S., Shao, S., Wang, Y., Zhang, F., and Wang, T. (2025). M2UD: A multi-model, multi-scenario, uneven-terrain dataset for ground robot with localization and mapping evaluation. arXiv.
38. Chen, J., and Xu, Y. (2022, January 10–12). DynamicVINS: Visual-inertial localization and dynamic object tracking. Proceedings of the China Automation Congress (CAC), Beijing, China.10.1109/CAC57257.2022.10055539 ↗