Precise Feature Removal Method Based on Semantic and Geometric Dual Masks in Dynamic SLAM
Source abstract
Abstract
In visual Simultaneous Localization and Mapping (SLAM) systems, dynamic elements in the environment pose significant challenges that complicate reliable feature matching and accurate pose estimation. To address the issue of unstable feature points within dynamic regions, this study proposes a robust dual-mask filtering strategy that synergistically integrates semantic segmentation information with geometric outlier detection techniques. The proposed method first identifies outlier feature points through rigorous geometric consistency checks, then employs morphological dilation to expand the initially detected dynamic regions. Subsequently, the expanded mask is intersected with instance-level semantic segmentation results to precisely delineate dynamic areas, effectively constraining the search space for feature matching and reducing interference caused by dynamic objects. A key innovation of this approach is the incorporation of a Perspective-n-Point (PnP)-based optimization module. This module dynamically updates the outlier set on a per-frame basis, enabling continuous monitoring and selective removal of dynamic features. Extensive experiments conducted on benchmark datasets demonstrate that the proposed method achieves average accuracy improvements of 3.43% and 11.42% on the KITTI dataset and 24% and 8.27% on the TUM dataset. Compared to traditional methods, this dual-mask collaborative filtering strategy improves the accuracy of dynamic feature removal and enhances the reliability of dynamic object detection, validating its robustness and applicability in complex dynamic environments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Robotic Path Planning Algorithms · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer and Electronic Information, Guangxi University, Nanning 530004, China
Nanning Huishi Technology Co., Ltd., Nanning 530000, China
Guangxi Intelligent Digital Services Research Center of Engineering Technology, Nanning 530004, China
Key Laboratory of Parallel, Distributed and Intelligent Computing (Guangxi University), Education Department of Guangxi Zhuang Autonomous Region, Nanning 530004, China
Funding
Guangxi Science and Technology Major Project for Laboratory Innovation Capacity Construction
References (35)
Show source-provided references
1. Probabilistic robotics10.1145/504729.504754 ↗
2. A critique of current developments in simultaneous localization and mapping10.1177/1729881416669482 ↗
3. Yang, D., Bi, S., Wang, W., Yuan, C., Wang, W., Qi, X., and Cai, Y. (2019). DRE-SLAM: Dynamic RGB-D Encoder SLAM for a Differential-Drive Robot. Remote Sens., 11.10.3390/rs11040380 ↗
4. Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age10.1109/TRO.2016.2624754 ↗
5. VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator10.1109/TRO.2018.2853729 ↗
6. ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM10.1109/TRO.2021.3075644 ↗
7. Direct Sparse Odometry10.1109/TPAMI.2017.2658577 ↗
8. Lianos, K.N., Schonberger, J.L., Pollefeys, M., and Sattler, T. (2018, January 8–14). Vso: Visual semantic odometry. Proceedings of the European conference on computer vision (ECCV), Munich, Germany.10.1007/978-3-030-01225-0_15 ↗
9. Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T. (2014). LSD-SLAM: Large-Scale Direct Monocular SLAM. Computer Vision–ECCV 2014, Proceedings of the 13th European Conference, Zurich, Switzerland, 6–12 September 2014, Springer.10.1007/978-3-319-10602-1 ↗
10. ORB-SLAM: A Versatile and Accurate Monocular SLAM System10.1109/TRO.2015.2463671 ↗
11. DynaTM-SLAM: Fast filtering of dynamic feature points and object-based localization in dynamic indoor environments10.1016/j.robot.2024.104634 ↗
12. SGD-SLAM: A visual SLAM system with a dynamic feature rejection strategy combining semantic and geometric information for dynamic environments10.1088/1361-6501/ada4ca ↗
13. DIG-SLAM: An accurate RGB-D SLAM based on instance segmentation and geometric clustering for dynamic indoor scenes10.1088/1361-6501/acfb2d ↗
14. Yan, L., Hu, X., Zhao, L., Chen, Y., Wei, P., and Xie, H. (2022). DGS-SLAM: A Fast and Robust RGBD SLAM in Dynamic Environments Combined by Geometric and Semantic Information. Remote Sens., 14.10.3390/rs14030795 ↗
15. MonoSLAM: Real-Time Single Camera SLAM10.1109/TPAMI.2007.1049 ↗
16. Klein, G., and Murray, D. (2007, January 13–16). Parallel Tracking and Mapping for Small AR Workspaces. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.10.1109/ISMAR.2007.4538852 ↗
17. ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras10.1109/TRO.2017.2705103 ↗
18. Fu, D., Xia, H., and Qiao, Y. (2021). Monocular Visual-Inertial Navigation for Dynamic Environment. Remote Sens., 13.10.3390/rs13091610 ↗
19. RGB-D SLAM in Dynamic Environments Using Point Correlations10.1109/TPAMI.2020.3010942 ↗
20. Wang, R., Wan, W., Wang, Y., and Di, K. (2019). A New RGB-D SLAM Method with Moving Object Detection for Dynamic Indoor Scenes. Remote Sens., 11.10.3390/rs11101143 ↗
21. Effective Background Model-Based RGB-D Dense Visual Odometry in a Dynamic Environment10.1109/TRO.2016.2609395 ↗
22. RGB-D SLAM in Dynamic Environments Using Static Point Weighting10.1109/LRA.2017.2724759 ↗
23. Motion removal for reliable RGB-D SLAM in dynamic environments10.1016/j.robot.2018.07.002 ↗
24. Scona, R., Jaimez, M., Petillot, Y.R., Fallon, M., and Cremers, D. (2018, January 21–25). StaticFusion: Background Reconstruction for Dense RGB-D SLAM in Dynamic Environments. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.10.1109/ICRA.2018.8460681 ↗
25. He, L., Li, S., Qiu, J., and Zhang, C. (2024). DIO-SLAM: A Dynamic RGB-D SLAM Method Combining Instance Segmentation and Optical Flow. Sensors, 24.10.3390/s24185929 ↗
26. Wang, Z., Zhang, Q., Li, J., Zhang, S., and Liu, J. (2019). A Computationally Efficient Semantic SLAM Solution for Dynamic Scenes. Remote Sens., 11.10.3390/rs11111363 ↗
27. Tateno, K., Tombari, F., Laina, I., and Navab, N. (2017, January 22–25). Cnn-slam: Real-time dense monocular slam with learned depth prediction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.695 ↗
28. Yu, C., Liu, Z., Liu, X.J., Xie, F., Yang, Y., Wei, Q., and Fei, Q. (2018, January 1–5). DS-SLAM: A semantic visual SLAM towards dynamic environments. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8593691 ↗
29. DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes10.1109/LRA.2018.2860039 ↗
30. Zhang, J., Henein, M., Mahony, R., and Ila, V. (2020). VDO-SLAM: A Visual Dynamic Object-aware SLAM System. arXiv.
31. Zhong, F., Wang, S., Zhang, Z., Chen, C., and Wang, Y. (2018, January 12–15). Detect-SLAM: Making Object Detection and SLAM Mutually Beneficial. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.10.1109/WACV.2018.00115 ↗
32. RDS-SLAM: Real-Time Dynamic SLAM Using Semantic Segmentation Methods10.1109/ACCESS.2021.3050617 ↗
33. PPS-SLAM: Dynamic Visual SLAM with a Precise Pruning Strategy
34. Ultralytics (2025, May 08). Ultralytics YOLO: State-of-the-art Deep Learning for Object Detection. Available online: https://github.com/ultralytics/ultralytics.
35. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗